Specialist Data/AI Engineering
1 week ago
Job Description:
Roles & Responsibilities
Minimum 6+ years of experience in the fundamental technology work of architecting/designing/building/managing/Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions.
Responsible for optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc.,
Conduct Proof-of-Concept activities in support of advanced use cases.
Must have architectural focus for ensuring availability, reliability and scalability are necessary
Responsible for documenting the technical solutions
Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance.
Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets.
Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses.
Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog.
Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools.
Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations.
Responsible for working with international teams spread across multiple time zones.
Must Have:
6 to 8 years of hands-on experience administering Azure Databricks in cloud environments.
In-depth knowledge and experience with Unity Catalog for data governance and security.
Proven expertise in cost optimization for Databricks clusters and cloud resources.
Strong understanding of Databricks architecture, cluster management, and job orchestration.
experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java,spark/Pyspark.
Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning.
Experience in Azure DevOps, Git/Github.
Azure Event Hub/ Azure Event Grid / Kafka
Hands-on experience with scripting languages such as Python, Scala, or SQL.
Experience with infrastructure-as-code tools like Terraform or ARM templates.
Solid understanding of data security, governance, and compliance standards.
Excellent problem-solving skills and ability to work in a collaborative environment.
Strong communication skills and ability to explain technical concepts to non-technical stakeholders.
Additional experience:
Hadoop Administration and/or Azure cloud Administration
Working with Object storage ( ADLS/Blob or S3), Kubernetes (preferably AKS)
Azure AD/ OpenID /OAuth/ SAML
NSG /Firewall deployment and usage
DNS configuration and management
Automation through Ansible or Teraform or Azure DevOps
Basic Linux administration and Shell scripting (Bash)
Good documentation skills
Ability to troubleshoot to isolate and diagnose common technical problems
Monitoring and use of monitoring tools for managing critical infrastructure
Preferred Certifications:
Microsoft Certified: Azure Administrator Associate/ Microsoft Certified: Azure Solutions Architect Expert
Databricks Accredited Platform Administrator Accreditation
#DataEngineering
Weekly Hours:
40Time Type:
RegularLocation:
IND:KA:Bangalore / Epip Area, Hoodi Village, Whitefield Rd - Eqp: Plot 111/112, Epip Area, Hoodi Village, Whitefield RoadIt is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.
-
Associate AI Engineer
4 days ago
Whitefield, Karnataka, India EProductivity Software Packaging Technol Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Summary:We are looking for a passionate and curious Junior AI Engineer with 1+ years of experience to join our growing AI team. This role offers an exciting opportunity to work on cutting-edge AI/ML projects, contribute to model development and deployment, and learn from experienced engineers and data scientists. You will support the design,...
-
AI Platform Lead Engineer
1 week ago
Whitefield, Karnataka, India Qualcomm Full time ₹ 50,00,000 - ₹ 75,00,000 per yearEngineer/ Sr Engineer/ Lead Sr Enginner, AI Platform Development>5 Years of Experience in Software Product Development.Our team is focused on applying state-of-the-art AI and ML technologies to solve complex business problems in the chip design, qualification, and debug engineering processes. We aim to enhance engineering efficiency through intelligent...
-
Senior Data Engineer
3 weeks ago
Hoodi, India HARMAN International Full timeHARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...
-
Data Security Engineer
3 weeks ago
Hoodi, India HARMAN International Full timeHARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...
-
AI/ML Developer
4 days ago
Whitefield, Karnataka, India SKILLABLERS Technologies Private Limited Full time ₹ 3,00,000 - ₹ 3,50,000 per yearAbout Skillablers Technologies PVT. LTD.:Skillablers Technologies PVT. LTD. is a dynamic and innovative technology company dedicated to providing cutting-edge solutions to businesses across various industries. We specialize in leveraging the power of Artificial Intelligence and Machine Learning to drive efficiency, optimize processes, and unlock new...
-
Senior Statistical Programming Specialist
1 week ago
Industrial Area, India MEDTEK AI Full timeCompany DescriptionMEDTEK AI is a data science-driven company focused on supporting faster drug development and healthcare solutions. Our team consists of senior statisticians, data scientists, statistical modeling and programming experts, data visualization specialists, cloud data engineers, data lake strategists, and regulatory submission and drug safety...
-
Lead Engineer Data Analytics and ML
1 week ago
Whitefield, Karnataka, India Qualcomm Full time ₹ 50,00,000 - ₹ 1,50,00,000 per yearSr Engineer/ Lead Sr Enginner, Data Analytics and ML Model DevelopmentTotal Exp >5 Years. Relevant Experience >2 Yrs.Our team is focused on applying state-of-the-art AI and ML technologies to solve complex business problems in the chip design, qualification, and debug engineering processes. We aim to enhance engineering efficiency through intelligent...
-
Principal Engineer
3 weeks ago
Hoodi, India HARMAN International Full timeHARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...
-
O2C Collections Specialist
5 hours ago
Bengaluru-EPIP Industrial Area, India Broadridge Full time ₹ 8,00,000 - ₹ 12,00,000 per yearAt Broadridge, we've built a culture where the highest goal is to empower others to accomplish more. If you're passionate about developing your career, while helping others along the way, come join the Broadridge team.About Broadridge:Broadridge Financial Solutions (NYSE: BR) is a global FinTech leader providing essential technology and operations solutions...
-
Technical Support Specialist
3 weeks ago
Industrial Area, India Scry AI Full timePosition: Client Support SpecialistLocation: India (Remote)Employment Type: Full-TimeSchedule: Monday to Friday, Day ShiftCompany DescriptionScry AI is a leading provider of AI-powered enterprise solutions, delivering transformational business outcomes through products like Collatio® (automation of complex document processing across financial, legal, and...