Staff Site Reliability Engineer - Big Data Platform Engineer(Python/Cloud)

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce. We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second across 80M merchants, 15k Financial Institutions, and billions of everyday people. While working with us you’ll get to work on complex distributed systems and solve massive scale problems centered on new payment flows, business and data solutions, cyber security, and B2C platforms.

The Opportunity:

As a Staff Site Reliability Engineer in Product Reliability Engineering, you will be part of a team that maintains and support Open Source Hadoop,Big data ,Kafka Platforms, Cloud ensuring their availability, performance, reliability, and improving operational efficiency. You will be responsible for driving innovation for our partners and clients, within Visa and globally.

The Work itself:

Essential Functions:

· Design, build and manage Hadoop and Kafka clusters on Cloud - AWS, GCP and Azure.

· Manage and optimize Open-Source Apache Hadoop, Big Data and Kafka clusters for high performance, reliability, and scalability.

· Develop tools and processes to monitor and analyze system performance and to identify potential issues.

· Collaborate with other teams to design and implement Solutions to improve reliability and efficiency of the in-premise Hadoop, Big data and Cloud platforms.

· Effective root cause analysis of major production incidents and the development of learning documentation.

· The role involves planning and performing capacity expansions and upgrades in a timely manner to avoid any scaling issues and bugs.

· The successful candidate will tune alerting and set up observability to proactively identify issues and performance problems.

· The role involves creating standard operating procedure documents and guidelines on effectively managing and utilizing the platforms.

The person will leverage DevOps tools, disciplines (Incident, problem, and change management), and standards in day-to-day operations.

· The individual will concentrate on developing tool and automations. This can be achieved through Ansible, Python, Java, or by using any other programming language.

The Skills You Bring:

· Energy and Experience: A growth mindset that is curious and passionate about technologies and enjoys challenging projects on a global scale.

· Challenge the Status Quo: Comfort in pushing the boundaries, “hacking” beyond traditional solutions.

· Language Expertise: Expertise in one or more general development languages (e.g., Java, python) or full stack development

· Learner: Constant drive to learn new technologies

· Partnership: Experience collaborating with Engineering, Application and Other functional teams.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Basic Qualifications

·5 or more years of relevant work experience with a Bachelors Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD

Preferred Qualifications

·6 or more years of work experience with a Bachelors Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD

·Experience with managing and optimizing Hadoop, Big Data and Kafka clusters in production environment

·Demonstrated experience with AWS EMR , MSK and GCP Hadoop and Kafka cloud platforms

·Proficient in one of programming languages Python, Java or full stack development.

·Familiarity with big data tools (Big Data, Spark, Kafka, etc.) and frameworks (HDFS, MapReduce, etc.).

·Strong knowledge in system architecture and design patterns for high-performance computing.

·Good understanding of data security and privacy concerns.

·Excellent problem-solving and troubleshooting skills.

·Strong communication and collaboration skills.

·Observability: knowledge on observability tools like Grafana, Opera and Splunk.

·Linux: understanding of Linux, networking, CPU, memory, and storage.

·Communication: Excellent interpersonal skills, along with superior verbal and written communication abilities.

Additional Information

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.

U.S. APPLICANTS ONLY: The estimated salary range for a new hire into this position is 124,700.00 to 180,650.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401 (k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.