Certified Data Engineer - Snowflake & Apache Spark - | Plano, TX - 5 Days Onsite | Contract W2 only

Job Title: Data Engineer Snowflake & Apache Spark

Location: Plano, TX - 5 Days Onsite

Experience 8+

Certification is Mandatory.

Job Summary:

We are seeking a skilled and certified Data Engineer with proven hands-on experience in Snowflake and Apache Spark. The ideal candidate holds a SnowPro Core or Advanced Certification and a Databricks Certified Associate Developer for Apache Spark, demonstrating their expertise in modern data platforms and distributed data processing. This role will involve building scalable data pipelines, optimizing data storage, and enabling real-time and batch data processing.

Key Responsibilities:

• Design, develop, and maintain robust, scalable ETL/ELT pipelines using Apache Spark and Snowflake.
• Leverage Databricks for data processing, transformation, and analytics in distributed environments.
• Develop efficient SQL and Spark applications to process and analyze large volumes of data.
• Implement and maintain data warehousing solutions using Snowflake with best practices for performance, cost, and security.
• Collaborate with data scientists, analysts, and business stakeholders to meet data needs.
• Ensure data quality and integrity through unit testing, data validation, and monitoring.
• Optimize and troubleshoot Spark jobs, SQL queries, and Snowflake data workflows.
• Integrate with various data sources (cloud storage, APIs, RDBMS) and tools (Airflow, DBT, etc.).
• Apply data governance and compliance policies in data pipeline design and execution .

Required Qualifications:

• Certifications:
  • SnowPro Core / Advanced Certification (e.g., SnowPro Advanced: Architect, Data Engineer, etc.)
  • Databricks Certified Associate Developer for Apache Spark (latest version preferred)
• Experience:
  • 3+ years of experience working with Snowflake, including schema design, query optimization, and Snowpipe/Streams/Tasks.
  • 2+ years of hands-on development with Apache Spark (PySpark, Scala, or Java) in Databricks or open-source environments.
  • Strong understanding of distributed computing, data lakes, and modern data architectures.
• Technical Skills:
  • Proficient in SQL, Spark (RDD/DataFrame APIs), and Python or Scala
  • Experience with cloud platforms (AWS, Azure, or GCP), especially integrating Snowflake and Databricks
  • Familiarity with data modeling, data quality, and orchestration tools (e.g., Airflow, Prefect)
  • Knowledge of CI/CD pipelines and version control (e.g., Git, GitHub Actions)

Preferred Qualifications:

• Experience with Delta Lake, MLflow, and Data Governance frameworks
• Familiarity with real-time data streaming (Kafka, Spark Structured Streaming)
• Strong communication and documentation skills
• Experience working in Agile/Scrum teams

About Next Gen Software Solutions LLC:

Next Gen Software Solutions is a trusted provider of IT Staffing and consulting services dedicated to empowering businesses with cutting-edge technology solutions and exceptional talent. We specialize in delivering tailored IT consulting services, innovative software solutions, and connecting businesses with highly skilled IT professionals. Founded and led by a dedicated U.S. Army solider, Next Gen Software Solutions is deeply rooted in the core values of integrity, discipline, commitment, and experience-principles that guide every aspect of our operations.

Equal Employment Opportunity Statement:

Next Gen Software Solutions LLC is an Equal Opportunity Employer. We are committed to fostering an inclusive and diverse workplace where all employees and applicants are treated respect and dignity. We do not discriminate based on race, colour, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, genetic information, veteran status, or any other legally protected characteristic under applicable federal, state, or local laws.

About Next Gen Software Solutions LLC:

Next Gen Software Solutions is a trusted provider of IT staffing and consulting services dedicated to empowering businesses with cutting-edge technology solutions and exceptional talent. We specialize in delivering tailored IT consulting services, innovative software solutions, and connecting businesses with highly skilled IT professionals. Founded and led by a dedicated U.S. Army soldier, Next Gen Software Solutions is deeply rooted in the core values of integrity, discipline, commitment, and excellence-principles that guide every aspect of our operations.