Senior Data Engineer

3 weeks ago

Bengaluru Karnataka India, Karnataka ITC Infotech Full time

Senior Data Engineer - Azure Stack

Experience - 3-12 years

Location : Bangalore, Kolkata, Gurgaon, Pune



We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions to support our business intelligence and analytics initiatives. You will work in a hybrid cloud environment to manage data services, ensuring high scalability, security, and performance for data-driven decision-making.


Key Responsibilities:

· Data Engineering: Design and implement scalable data pipelines, ETL workflows, and processing frameworks within Azure Stack and hybrid cloud environments.

· Cloud Architecture: Leverage the capabilities of Azure Stack, Azure Data Factory, Azure Synapse Analytics, and other Azure cloud services to integrate, manage, and optimize enterprise data solutions.

· Data Integration & Storage: Build and optimize data lakes, data warehouses, and cloud-based storage systems on Azure, integrating structured and unstructured data from multiple sources.

· Performance Optimization: Continuously improve data pipelines for performance, scalability, and cost-efficiency. Implement automation and monitoring solutions to ensure smooth operation.

· Cross-Functional Collaboration: Work closely with product managers, data scientists, and business intelligence teams to implement data models, data visualizations, and analytics solutions.

· Mentorship: Provide mentorship and technical leadership to junior engineers, helping them improve their skills in cloud data technologies, coding standards, and engineering best practices.

· Cloud Migration: Assist in the migration of on-premises data infrastructure to Azure Stack, working closely with infrastructure teams to ensure a seamless transition.


Required Skills & Qualifications:

· Experience: 3-12 years of experience in data engineering, with at least 2+ years of experience working specifically with Azure Stack and Azure cloud services in a hybrid environment.

· Azure Stack Expertise: Proficient in Azure Stack Hub, Azure Data Factory, Azure SQL Database, Azure Synapse Analytics, Azure Databricks, and Azure Blob Storage.

· Programming Skills: Proficiency in SQL, Python, or similar scripting languages for building data pipelines and processing large datasets.

· ETL Tools: Experience with building and optimizing ETL workflows using Azure Data Factory, Apache Airflow, or other similar tools.

· Data Integration: Experience working with data integration tools, including both structured and unstructured data sources, and technologies such as Kafka, Spark, Hadoop, or others.

· Data Warehousing & Storage: Strong understanding of data warehousing concepts (e.g., star/snowflake schemas) and expertise with Azure Data Lakes and SQL/NoSQL storage solutions.

· Big Data Technologies: Familiarity with big data technologies like Apache Hadoop, Apache Spark, Databricks, and Kafka is a plus.


Soft Skills:

· Excellent analytical and problem-solving abilities.

· Strong communication skills to articulate technical details to non-technical stakeholders.

· Ability to work collaboratively in a distributed team environment.

· Self-motivated, proactive, and able to work under minimal supervision.

· Strong attention to detail, ensuring data quality and security.

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 10 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual Interview Job Description:Python, Scala/Java, Spark, SQL, Snowflake, Airflow, Databricks, AWS Big data technologiesDesign, develop,...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Publicis Production Full time

    Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Avathon Full time

    Who We Are & Why Join UsAvathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Grid Dynamics Full time

    About Company Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Benchire Full time

    Hi, We are Hiring for a Senior data Engineer with 6-8 years of Experience for a IT Services company based in Bangalore .Requirements:· Min 6-8 years of professional experience· Minimum of three years of professional experience with Python· Professional experience in the field of data (e.g., data science, data engineering, data warehousing)· Experience...

  • Senior Azure Data Engineer

    2 hours ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    Mandatory* Experience building data pipelines* Highly proficient in python, Data frames* Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB* Highly proficient in SQL Query* Snowflake or experience with similar analytics database* Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code...

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Senior Engineer Req ID: 337668 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...