GCP Data Engineer
Houston, TX
Long Term Contract Key Responsibilities:
- Design, develop, and manage robust, scalable, and efficient data pipelines on GCP.
- Build and maintain data workflows using Apache Airflow for orchestration.
- Work with Google BigQuery for large-scale analytics and data storage.
- Leverage Google Cloud Dataflow (Apache Beam) for real-time and batch data processing.
- Ingest, transform, and analyze massive datasets (millions+ of records).
- Collaborate with data scientists, analysts, and other engineering teams to deliver reliable data solutions.
- Optimize data performance and troubleshoot data pipeline issues in production.
- Ensure data quality, integrity, and security across all data platforms.
- 4+ years of hands-on experience with Google Cloud Platform (GCP)services.
- Strong experience with BigQuery, Dataflow, and Airflow .
- Proficiency in Python or Java for data processing and pipeline development.
- Deep understanding of big data processing principles and distributed systems.
- Hands-on experience working with millions of rows/records in large-scale environments.
- Experience with data lake and data warehouse architectures.
- Strong problem-solving skills and ability to debug complex systems.
- Automating specific system operations to enhance efficiency and speed
- Testing designs to find and fix mistakes and make system improvements
- Evaluating and identifying the best cloud solutions in collaboration with engineering and development teams
- Developing, establishing and implementing modular cloud-based applications
- Locating, evaluating and fixing infrastructure risks and deployment problems
- Periodically evaluating computer systems and offering suggestions for performance enhancements
- Offering support and guidance to meet customer requirements
Recommended Jobs
Front End Engineer
Front End Engineer Habitat Energy is a fast growing technology company focussed on the physical and financial optimisation of energy storage and renewable generation assets globally through comple…
Tax Supervisor
Job ID#: 35485 Tax Supervisor Needed! Job Description: Tax Supervisor is expected to perform all aspects of various returns and tax compliance activities, as well as direct less tenured assoc…
Austin - Wealth Preservation Associate Attorney
WEALTH PRESERVATION ASSOCIATE ATTORNEY Location: Austin, TX ON-SITE A premier AmLaw 200 firm is seeking a talented Associate Attorney to join its highly-regarded Wealth Preservation…
AI Growth Marketing Lead (BioCompute)
&##128640; We're hiring: AI Growth Marketing Lead BioCompute.ai / iTmethods Fortress Family Location: Remote-first. We have hubs in Toronto and Austin, and prioritize candidates in these reg…
Locum NP (Nurse Practitioner);PA (Physician's Assistant) Cardiothoracic Surgery;Vascular Surgery
Description . In this role, you will provide essential support in surgical settings, working closely with surgeons and other healthcare professionals to ensure the highest level of patient care…
Clinical Coding Analyst (Remote)
Not hiring out of CA Essential Job Duties and Responsibilities: • Clinical Coding Analysts are assigned to a specific client(s) and have the primary responsibility of daily pre-bill chart …
Senior Cloud Platform Developer - Vice President
We’re seeking a Senior Cloud Platform Developer who blends strong software engineering fundamentals with 6+ years of deep hands-on cloud and Kubernetes experience. You’ll architect and deliver Terr…
Test Manager, Engineering (Austin, TX)
Req ID: 129677 Region: Americas Country: USA State/Province: Texas City: Austin General Overview Job Title: Manager, Software Engineering 1 Functional Area: Engineering (ENG) C…
Delivery Driver - up to 25 per hour - Bonus of 500
Delivery Driver position - apply today and start next week! This is a FULL-TIME Position NOT Seasonal. NO EXPERIENCE REQUIRED! WILLING TO TRAIN THE RIGHT CANDIDATES! Based in Nacogdoches. No Com…
Director of Strategic Partnerships and Alliances
About us Concord isn't your typical consulting firm; we're an execution-focused company passionate about delivering results. Our mission is to help clients enhance customer experiences, optimize o…