Data Engineer

About
the job: Data Engineer

Career
Level
: Mid-level

Location


: Hybrid / Onsite

Who
We Are:

This
is Spearhead Technology — where every challenge is an
opportunity, and every solution is a masterpiece in the making.
As a full-lifecycle IT company, we transcend mere delivery; we
engineer success.

From
inception to implementation, our seasoned expertise shepherds
every phase of the journey. Be it planning, analysis, design,
development, testing, or the seamless transition to production,
we stand as steadfast partners in our clients’ progress.

At
Spearhead Technology, quality isn't a mere
aspiration—it's our ethos. Rooted in Tech Advisory, our
methodology is guided by insights that spark transformative
outcomes. We recognize the paramount importance of talent
retention. Through a steadfast commitment to work-life balance,
competitive remuneration packages, and an optimized operational
model, we ensure our team remains as exceptional as our
services.

Step
into Spearhead Technology, where innovation meets precision, and
together, let's sculpt the future of technology with finesse
and distinction.

Requirements

We
are seeking individuals who demonstrate exceptional skills and are
passionate about making a difference.

Responsibilities:

• Work with a team of data and software engineers to deliver big data streaming platform and data management capabilities.
• Develop cutting edge software solutions by writing maintainable, extensible, tested code, while complying with coding standards
• Be hands-on and lead from the front in following best practices in development, microservices design and CI/CD methodologies
• Facilitate end to end user testing with customers.
• Troubleshoot, debug and upgrade existing systems.
• Help bridge gaps between Toyota Connected, other Toyota Entities, and 3 rd party suppliers.
• Work closely with product owners to shape and deliver features to customers.
• Embrace emerging technology opportunities and contribute to our best practices, driving overall architecture, security, design.
• Write full-stack software and tooling, ensuring code is well-tested and performant.
• Develop tools and libraries that will enable rapid and scalable development in the future.
• Contribute to all aspects of the software development life cycle across multiple, interconnected software products.
• Support responsibilities will include investigating issues our customers have with retrieving data via our data products.
• debugging APIs, cloud services, and data lake technologies

Required Qualifications:

• 3+ years of data engineering experience
• Solid experience writing clean, concise, tested, maintainable code in python.
• Experience building and deploying applications in AWS
• API development experience
• Experience utilizing Spark and SQL
• Experience with Databricks or EMR
• Experience with CI/CD and updating build pipelines and pipeline tasks
• Hands-on production experience working with Big Data platforms, building and optimizing data pipelines that involve data processing and streaming platforms
• Experience in test automation frameworks, optimizing performance and security enabling delivery of robust and maintainable architecture.
• Ability to learn and apply new technologies, programming practices, patterns, and methods
• Demonstrates advanced problem-solving, troubleshooting, decision making skills
• Organized and detail-oriented
• Ability to develop healthy working relationships and collaborate with peers and leaders
• Exhibits integrity and high standards in work quality
• Excellent verbal and written communication skills
• Values diversity and differences amongst individuals in interactions

Benefits

What’s
in it for you:

At
Spearhead Technology, we prioritize your well-being and
professional growth. Here's what you can expect:

• Achieve
  a healthy work-life balance.
• Competitive
  compensation and abundant growth opportunities.
  
• Enjoy
  a standard 5-day workweek with 2 fixed weekly
  offs.
• Experience
  an employee-centric environment with supportive
  policies.
• Benefit
  from family-friendly and flexible work
  arrangements.
• Access
  our Performance Advancement and Career Enhancement (PACE)
  initiative and discover opportunities for both personal and
  professional growth. From tailored career development plans to
  expert counseling services, PACE empowers you to chart your
  course to success with confidence and clarity.
  Elevate
  your career trajectory with our Learning & Development
  (L&D) program. Join our team and embark on a
  transformative journey of upskilling and self-discovery. With
  continuous learning as your compass, you'll not only
  enhance your expertise but also open doors to new
  opportunities, paving the way for career growth and
  fulfillment.
  

Please
note :

At Spearhead Technology, we value the importance of
collaboration, learning, and fostering connections with clients,
peers, leaders, and communities. While some in-person engagement
may be required for certain roles, we are committed to providing
flexibility to accommodate your individual work-life balance
needs.

As
an equal opportunities’ employer, Spearhead Technology welcomes
and encourages applications from all members of society. We are
dedicated to creating an inclusive environment where diversity
is celebrated, and individuals are valued for their unique
perspectives and contributions. We do not discriminate on the
basis of race, religion or belief, ethnicity, disability, age,
citizenship, marital or civil partnership status, sexual
orientation, or gender identity.