indeed
Lead AI Engineer || Immediate Joiner
Enable Data
Karnataka, IND
Onsite
Discovered 1 months ago
DatabricksPySpark and PySQLAzure cloud resourcesData ingestion pipelinesDatabricks Unity Catalog and permissionsDatabricks Apps and Visual Studio Code
Key Skills for This Role
DatabricksPySpark and PySQLAzure cloud resourcesData ingestion pipelinesDatabricks Unity Catalog and permissionsDatabricks Apps and Visual Studio Code
Full Job Posting
Solution and data architecture
- Modify source code for architectural needs, including authentication changes and Databricks forwarded headers.
- Participate in technical reviews for Azure resource configuration.
- Prepare technical and network architecture documentation for cloud and security reviews and approvals.
Databricks development
- Design and build data ingestion pipelines into Databricks from sources such as SAP and website scraping, using PySpark and PySQL.
- Write scenario-based and edge-case tests and work with stakeholders to finalize code changes and acceptance criteria.
- Work with Unity Catalog permissions, OBO tokens, and service principals for Databricks Agents, Genie Spaces, machine learning, and foundation models.
- Build and deploy Databricks Apps using Visual Studio Code and send custom notifications through APIs to team-channel webhooks.
AI application development
- Build minimal single-page chat applications using FastAPI or React and Claude models or APIs.
- Use system and user prompts, prompt engineering, token economics, and prompt-based rule enforcement.
- Use graphs to identify dependencies between rules and circular references; use Claude Vision as well as text processing.
- Develop retrieval-augmented generation using Databricks AI Search indexes and hierarchical chunking.
- Implement basic AI safety guardrails and use caching mechanisms.
Full-stack development and DevOps
- Understand and troubleshoot frontend, backend, middleware, data layers, and routes; rewrite code to address security findings.
- Document code using techniques such as TDD, FDD, DFD, and SDs.
- Create and automate Azure DevOps CI/CD pipelines for Teams bots, web applications, and Databricks bundles or notebooks.
- Configure pipeline environments and add validation steps such as Snyk scans and linting.
Working expectations
- Work independently as an individual contributor in short sprint cycles.
- Collaborate closely with client-side toxicologists and project managers while working from concise requirements.
Application details
- The posting requests a resume and details including total and relevant years, current and expected compensation, and notice period; immediate joiners are requested.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Enable Data
Lead/Sr AI Engineer with Azure Data Bricks || Immediate Joiner
, IND
Lead
Enable Data seeks a Lead/Senior AI Engineer to build and operate production AI applications on Azure Databricks and Azure cloud services. You will deliver data pipelines, ML and generative AI solutions, CI/CD, monitoring
Discovered 1 months agoView →
Lead/Sr AI Engineer with Azure Data Bricks || Immediate Joiner
, IND
Lead
Enable Data is seeking a Lead/Senior AI Engineer to build and operate production-ready AI applications on Azure Databricks and Azure cloud infrastructure. The role covers data and AI pipelines, ML and generative AI deplo
Discovered 1 months agoView →