Sr Data Engineer L3

Benefits:

• Hybrid


• Long Term


• Opportunity for advancement

Senior Data Engineer
Location: Dallas, TX (Hybrid—3 days onsite)

Duration: Long-term Project

Interview: In-person

Roles and Responsibilities:

• Migrate data from On-prem to AWS Redshift with zero data loss.


• Build batch and real-time data pipelines using Python .


• Set up and manage Kafka on AWS for streaming data.


• Automate ETL workflows using AWS Glue and store data in S3.


• Design data solutions in Redshift for fast querying.


• Create reusable frameworks to reduce development time and improve code.


• Build dashboards and reports for client data insights.


• Use GitLab CI/CD for testing and deployments.


• Work with AWS tools like Lambda, SQS, SNS, Glue, DynamoDB, OpenSearch, and more.


• Develop tools to generate mock data (JSON, CSV, XML).


• Deploy containerized apps using Kubernetes.


• Follow best practices to ensure data security and compliance.

Qualifications:

• Strong experience in Python and cloud technologies - AWS.


• Good understanding of Kafka, ETL, and data warehouses.


• Familiarity with CI/CD, boto3, and Kubernetes is a big plus.

Flexible work from home options available.

Compensation: $55.00 - $65.00 per hour

About Us

We work to deliver profitability in your business – with effective communication, consulting, and interactive solutions. Following an Agile Work Approach, we make sure you get the ideal solutions at minimum expenses.

Work Approach

Our Philosophy
Our Philosophy starts-and-ends at the Client-first approach. Be it understanding your business requirements to choosing the right technologies, we work as a collective team that takes all the possible steps to grow continuously towards our common goal.

Work Policy

We promote a collaborative work environment. We involve everyone working in the organization in community decisions and encourage them to think from a broader perspective. Our work process promotes flexibility and we maintain a high level of discipline at different levels of execution.

The Future

SelectMinds have years of experience in the domain helps us understand the need-of-the-hour better. This understanding drives us to a better future with every minute ticking. We believe we will be taking off major businesses from their flagship positions, with the products we are eyeing today.