{bc}
workday

Staff Data Engineer

Visa
Bengaluru, IND
Full-time
Senior · 3+ years experience
Onsite
Discovered 3 weeks ago
githadoophivejavapythonspark

Full Job Posting

Qualifications

  • Basic Qualifications
  • 6+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.
  • Experience in solving data problems using data technologies
  • Experience with Hadoop, Hive, HBase, Spark, Trino, or comparable distributed data systems.
  • Experience in designing and implementing data pipelines and large-scale data processing jobs.
  • Experience in writing, modifying, and reviewing high-quality, testable, and efficient code.
  • Data pipelines, ETL/ELT, data-quality frameworks, Java or Python, SQL, Git, and production troubleshooting.
  • Experience in developing unit, integration, and end-to-end tests with a focus on automation.
  • Experience in building and maintaining CI/CD pipelines and deploying applications using containerization and orchestration tools.
  • Experience in monitoring applications in production and troubleshooting issues using observability tools.
  • Experience in integrating AI or ML services into applications, where applicable.
  • Experience in collecting and analyzing metrics to guide optimizations and improvements.
  • Experience in partnering with stakeholders to clarify requirements and ensure deliverables meet business needs.
  • Experience in applying secure coding practices and complying with regulatory standards.
  • Preferred Qualifications
  • 6 or more years of work experience with a Bachelor's Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD.
  • Experience in contributing in Open source components.
  • Use/Build AI agents, and agentic patterns to improve development, testing, operations, troubleshooting, automation, onboarding, and documentation.
  • Experience in enterprise-class systems engineered for high availability, low latency, scalability, and supportability. Architecture depth across storage/compute separation, query and table formats, streaming, metadata, governance, and interoperability.
  • Experience in building and pushing code into production.
  • Experience in implementing and supporting real-time systems.
  • Experience in mentoring junior engineers and writing clear technical documentation.
  • Visa is an EEO Employer
  • Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Preferred Qualifications

  • 6 or more years of work experience with a Bachelor's Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD.
  • Experience in solving data problems using data technologies
  • Experience with Hadoop, Hive, HBase, Spark, Trino, or comparable distributed data systems.
  • Experience in contributing in Open source components.
  • Use/Build AI agents, and agentic patterns to improve development, testing, operations, troubleshooting, automation, onboarding, and documentation.
  • Data pipelines, ETL/ELT, data-quality frameworks, Java or Python, SQL, Git, and production troubleshooting.
  • Experience in enterprise-class systems engineered for high availability, low latency, scalability, and supportability. Architecture depth across storage/compute separation, query and table formats, streaming, metadata, governance, and interoperability.
  • Experience in building and pushing code into production.
  • Experience in implementing and supporting real-time systems.
  • Experience in mentoring junior engineers and writing clear technical documentation.
  • Visa is an EEO Employer
  • Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Responsibilities

  • Independently understand data ecosystems, security, privacy, and retention requirements to support business and product features.
  • Act as a key participant in meetings with stakeholders to identify and clarify requirements and determine business needs.
  • Translate functional requirements into architecture designs for one or more components, leveraging existing architecture design patterns, and communicate these to Data Engineers.
  • Implement extensible, maintainable, and reusable code using appropriate coding patterns, guidelines, and best practices; participate in code reviews to ensure standards are followed.
  • Provide end-to-end ownership of data products or data pipelines, including mitigation of technical debt and documentation of errors or unexpected bugs.
  • Identify and conduct required testing for moderately complex use cases, including unit testing, coding standards, and security scans.
  • Build tools and standard automation processes to assist in transforming, managing, accessing, deploying, and monitoring data processes in batches and in real time.
  • Write queries to extract and compile raw data across end-to-end pipelines, and implement orchestration techniques to automate data extraction logic.
  • Ensure adherence to data management principles, governance, and tools to maintain data quality across multiple features.
  • Develop and update troubleshooting guidance and procedures for reviewing, addressing, and fixing advanced problems flagged by testing.
  • Manage software upgrades and server patches for security remediation where applicable.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Visa