Lead Java Developer with PySpark
Job Title: Lead Java Developer with PySpark
Locations: Dallas, TX / Pittsburgh, PA / Cleveland, OH Hybrid (Onsite 2–3 days per week)
Job Summary:
We are seeking a highly experienced Lead Java Developer with expertise in Apache Spark (PySpark) to join a critical data engineering and backend development initiative. The ideal candidate will lead a team of engineers in designing and implementing scalable backend solutions, integrating with large-scale data pipelines.
Key Responsibilities:
- Lead the design and development of scalable backend services using Java and Spring Boot
- Develop batch and real-time data processing pipelines using PySpark on Apache Spark
- Work closely with Data Engineers, Architects, and DevOps teams to ensure smooth data flow and platform stability
- Optimize and tune performance of Java applications and PySpark jobs
- Implement and enforce best practices in code quality, testing, and deployment
- Participate in Agile ceremonies and work closely with business stakeholders to deliver solutions
- Mentor junior developers and review code to ensure maintainability and performance
Required Skills & Experience:
- 10+ years of hands-on experience in Java development (Java 8+)
- Strong experience with Spring Boot, REST APIs, and Microservices
- Proficient in PySpark and distributed data processing using Apache Spark
- Hands-on experience with Hadoop Ecosystem, HDFS, and Hive
- Experience working with Kafka for data streaming
- Strong knowledge of SQL, data modeling, and performance tuning
- Exposure to CI/CD pipelines, Docker, and Kubernetes is a plus
- Excellent problem-solving, communication, and leadership skills
Preferred Qualifications:
- Experience in Banking / Financial Services domain
- Familiarity with AWS / Azure cloud platforms
- Exposure to tools like Airflow, Databricks, or Snowflake is a plus
Education:
- Bachelor's or Master’s Degree in Computer Science, Engineering, or related field
Recommended Jobs
Director, Paid Media
JOB SUMMARY: The Director, Paid Media is a strategic leader responsible for driving innovative, results-oriented digital campaigns across programmatic, social, search, display, video, and mobile. Th…
SR INSTRUCTIONAL DESIGNER
Description Position at Pilgrim's Senior Instructional Designer This is NOT a remote work position. Description: This position is responsible for designing, developing and maintaining cur…
Optometrist-San Juan, Puerto Rico-LensCrafters
Requisition ID: 900010 Store # : D00474 LensCrafters Drs Office Position: Full-Time Total Rewards: Benefits/Incentive Information LensCrafters is a place for visionaries. We’ve got a…
Parts Counter/ Service Associates
Experience:Parts, sales, or inventory: 2 years (Preferred but not required) powersports parts and service: 1 year (preferred but not required) Apply online below or email: [email protected] …
Senior Associate Technology - Java Developer
Job Description As a Senior Associate Technology specializing in Java Microservices, you will be responsible for designing, developing, and implementing scalable, high-performance microservices-bas…
Tire Retread Technician
Cook Tire in Nacogdoches is hiring Tire Retread Technicians Starting Pay $14 to $17 Hourly (Negotiable Based Upon Experience) Looking for a company that cares about you and offers the best-i…
Warehouse Associate - Loader/Unloader - 2nd Shift
**Requisition Number:** 207760 **Job Description** Cintas is seeking a Warehouse Associate - Loader/Unloader to support the Rental Division. Loader/Unloaders are responsible for driving company truc…
Networking Support Ninja
Are you a networking guru? Do you have the personal skills, patience, temperament and know-how to help our customers find success in deploying edge devices in unknown networks? If so, we are looking f…
General | Physician
Locum Tenens Family Practice Physician Job – Primary Care in Saint Johnsbury, Vermont Seeking a board-certified or board-eligible Family Practice Physician for a locum tenens primary care position …
HVAC/Plumbing Senior Estimator
We are a large growing HVAC/Plumbing contractor in Austin that works on many of Texas’s biggest and best HVAC/Plumbing projects. This is a full-time position with great benefits. We are planning to h…