Sr Specialist Data/AI Engineering

2 weeks ago

Hyderabad, India AT&T Full time

Job Description

:

Key Responsibilities:

Data Engineering & Architecture:

Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark. Build and manage scalable data ingestion frameworks for batch and real-time data processing. Implement and optimize data lake architecture in Azure Data Lake to support analytics and reporting workloads. Develop and optimize data models and queries in Azure Synapse Analytics to power BI and analytics use cases.

Cloud-Based Data Solutions:

Architect and implement modern data lakehouses combining the best of data lakes and data warehouses. Leverage Azure services like Data Factory, Event Hub, and Blob Storage for end-to-end data workflows. Ensure security, compliance, and governance of data through Azure Role-Based Access Control (RBAC) and Data Lake ACLs.

ETL/ELT Development:

Develop robust ETL/ELT pipelines using Azure Data Factory, Data Bricks notebooks, and PySpark. Perform data transformations, cleansing, and validation to prepare datasets for analysis. Manage and monitor job orchestration, ensuring pipelines run efficiently and reliably.

Performance Optimization:

Optimize Spark jobs and SQL queries for large-scale data processing. Implement partitioning, caching, and indexing strategies to improve performance and scalability of big data workloads. Conduct capacity planning and recommend infrastructure optimizations for cost-effectiveness.

Collaboration & Stakeholder Management:

Work closely with business analysts, data scientists, and product teams to understand data requirements and deliver solutions. Participate in cross-functional design sessions to translate business needs into technical specifications. Provide thought leadership on best practices in data engineering and cloud computing.

Documentation & Knowledge Sharing:

Create detailed documentation for data workflows, pipelines, and architectural decisions. Mentor junior team members and promote a culture of learning and innovation.

Required Qualifications:

Experience:7+ years of experience in data engineering, big data, or cloud-based data solutions.Proven expertise with Azure Data Bricks, Azure Data Lake, and Azure Synapse Analytics. Technical Skills:Strong hands-on experience with Apache Spark and distributed data processing frameworks.Advanced proficiency in Python and SQL for data manipulation and pipeline development.Deep understanding of data modeling for OLAP, OLTP, and dimensional data models.Experience with ETL/ELT tools like Azure Data Factory or Informatica.Familiarity with Azure DevOps for CI/CD pipelines and version control. Big Data Ecosystem:Familiarity with Delta Lake for managing big data in Azure.Experience with streaming data frameworks like Kafka, Event Hub, or Spark Streaming. Cloud Expertise:Strong understanding of Azure cloud architecture, including storage, compute, and networking.Knowledge of Azure security best practices, such as encryption and key management.

Preferred Skills (Nice to Have):

Experience with machine learning pipelines and frameworks like MLFlow or Azure Machine Learning. Knowledge of data visualization tools such as Power BI for creating dashboards and reports. Familiarity with Terraform or ARM templates for infrastructure as code (IaC). Exposure to NoSQL databases like Cosmos DB or MongoDB.

Weekly Hours:

40

Time Type:

Regular

Location:

Hyderabad, Andhra Pradesh, India

It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.

  • Ai Data Scientist

    1 day ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 327884 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Data Scientist - Digital Engineering Sr Engineer to join our team in Hyderabad Telangana IN-TG India IN ARTIFICIAL...

  • Data Engineer

    1 week ago

    Hyderabad, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%)  Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Sr Gen AI Engineer

    3 weeks ago

    Hyderabad, India Blue Yonder Full time

    Overview Blue Yonder is looking for an experienced Sr Gen AI Engineer to contribute to the design, development, and implementation of agentic AI-driven solutions at Blue Yonder. This role is not a research role and requires being hands-on and building agentic AI POCs from the ground up to demonstrate the "art of the possible" and business value. The Sr Gen...

  • Sr Gen AI Engineer

    6 days ago

    Hyderabad, Telangana, India Blue Yonder Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    OverviewBlue Yonder is looking for an experienced Sr Gen AI Engineer to contribute to the design, development, and implementation of agentic AI-driven solutions at Blue Yonder.This role is not a research role and requires being hands-on and building agentic AI POCs from the ground up to demonstrate the "art of the possible" and business value.The Sr Gen AI...

  • Data & Ai Strategist

    22 hours ago

    Hyderabad, Telangana, India NTT DATA Full time

    **Req ID**: 341164 We are currently seeking a Data & AI Strategist to join our team in Hyderabad, Telangana (IN-TG), India (IN). **Location**: | **Experience**: 15+ years (5+ in AI/ML architecture) **Role Overview** **Key Responsibilities** - Architect and deliver **GenAI, LLM, and agentic AI solutions**: - Excellent understanding of Agentic Frameworks,...

  • AI Engineer

    3 weeks ago

    Hyderabad, India Deccan AI Full time

    Location:Hyderabad (On-site/Hybrid) Company:Deccan AI Employment Type:Full-Time Experience:1–3 Years About Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and...

  • AI Engineer

    2 weeks ago

    Hyderabad, Telangana, India Deccan AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Location:Hyderabad (On-site/Hybrid)Company:Deccan AIEmployment Type:Full-TimeExperience:1–3 YearsAbout Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and work...

  • AI Engineer

    7 hours ago

    Hyderabad, Telangana, India Transnational Ai Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    • Contribute to planning, building & maintaining agentic AI workflows• Work with LLMs, vector stores, prompt engineering & RAG pipelines.• Integrate agents with internal APIs, external tools, databases, & cloud services. Required Candidate profile• B.Tech / B.E. / M.Tech in Computer Science, AI, Data Science, or related fields.• Strong programming...

  • Ai presales

    2 days ago

    Hyderabad, India Multiplier AI Full time

    Role: AI Pre-Sales & Lead Generation Specialist (builds pipeline using content marketing, AI tools, multi channel outreach)Experience : 1 to 4 years Multiplier AI About Multiplier AI Limited Learn to sell AI products You will lead a team reporting to top leadership and founders The KPI is to build a 2m USD pipeline via outreach and marketing. Multiplier AI...

  • Ai presales

    1 day ago

    Hyderabad, India Multiplier AI Full time

    Role: AI Pre-Sales & Lead Generation Specialist (builds pipeline using content marketing, AI tools, multi channel outreach)Experience : 1 to 4 years Multiplier AI About Multiplier AI Limited Learn to sell AI products You will lead a team reporting to top leadership and founders The KPI is to build a 2m USD pipeline via outreach and marketing. Multiplier AI...