Specialist Data/AI Engineering

Roles & Responsibilities

• Minimum 6 years of experience in the fundamental technology work of architecting/designing/building/managing/optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions.
• Responsible for optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc.
• Conduct Proof-of-Concept activities in support of advanced use cases.
• Must have architectural focus for ensuring availability, reliability, and scalability are necessary.
• Responsible for documenting the technical solutions.
• Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance.
• Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets.
• Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses.
• Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog.
• Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools.
• Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations.
• Responsible for working with international teams spread across multiple time zones.

• 6 to 8 years of hands-on experience administering Azure Databricks in cloud environments.
• In-depth knowledge and experience with Unity Catalog for data governance and security.
• Proven expertise in cost optimization for Databricks clusters and cloud resources.
• Strong understanding of Databricks architecture, cluster management, and job orchestration.
• Experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java, Spark/PySpark.
• Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning.
• Experience in Azure DevOps, Git/GitHub.
• Azure Event Hub/Azure Event Grid/Kafka.
• Hands-on experience with scripting languages such as Python, Scala, or SQL.
• Experience with infrastructure-as-code tools like Terraform or ARM templates.
• Solid understanding of data security, governance, and compliance standards.
• Excellent problem-solving skills and ability to work in a collaborative environment.
• Strong communication skills and ability to explain technical concepts to non-technical stakeholders.

• Hadoop Administration and/or Azure Cloud Administration.
• Working with Object storage (ADLS/Blob or S3), Kubernetes (preferably AKS).
• Azure AD/OpenID/OAuth/SAML.
• NSG/Firewall deployment and usage.
• DNS configuration and management.
• Automation through Ansible or Terraform or Azure DevOps.
• Basic Linux administration and Shell scripting (Bash).
• Good documentation skills.
• Ability to troubleshoot to isolate and diagnose common technical problems.
• Monitoring and use of monitoring tools for managing critical infrastructure.

• Microsoft Certified: Azure Administrator Associate / Microsoft Certified: Azure Solutions Architect Expert.
• Databricks Accredited Platform Administrator Accreditation.

40

Regular

IND:KA:Bangalore / Epip Area, Hoodi Village, Whitefield Rd - Eqp: Plot 111/112, Epip Area, Hoodi Village, Whitefield Road

It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.

Job ID: R-82306
Date posted: 09/24/2025
Locations: Hyderabad, India