Assistant Manager-Data Engineering-Big Data Engineering

3 days ago

Pune, Maharashtra, India EXL Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Description

Key Responsibilities:

  • Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
  • Build and maintain data integration workflows from various data sources to Snowflake.
  • Write efficient and optimized SQL queries for data extraction and transformation.
  • Work with stakeholders to understand business requirements and translate them into technical solutions.
  • Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
  • Maintain and enforce data quality, governance, and documentation standards.
  • Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Must-Have Skills:

  • Strong experience with Azure Cloud Platform services.
  • Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines.
  • Proficiency in SQL for data analysis and transformation.
  • Hands-on experience with Snowflake and SnowSQL for data warehousing.
  • Practical knowledge of DBT (Data Build Tool) for transforming data in the warehouse.
  • Experience working in cloud-based data environments with large-scale datasets.

Good-to-Have Skills:

  • Experience with DataStage, Netezza, Azure Data Lake, Azure Synapse, or Azure Functions.
  • Familiarity with Python or PySpark for custom data transformations.
  • Understanding of CI/CD pipelines and DevOps for data workflows.
  • Exposure to data governance, metadata management, or data catalog tools.
  • Knowledge of business intelligence tools (e.g., Power BI, Tableau) is a plus.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • 7+ years of experience in data engineering roles using Azure and Snowflake.
  • Strong problem-solving, communication, and collaboration skills.
Responsibilities

Develop and manage small data modelling projects. Ensure adherence to data modelling standards. Develop and deliver training sessions. Provide feedback to junior team members.

Qualifications

Graduate in Computer Science, Data Science, or a related field. 2-3 years of experience in data modelling or data analysis.

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Vodafone Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Design, develop, and maintain scalable data pipelines for processing structured and unstructured data. Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses. Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows. Ensure high performance and...

  • Big Data Engineer

    5 days ago

    Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Big Data Engineer

    3 days ago

    Pune, Maharashtra, India Capco Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job Title:Big Data EngineerAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking,...

  • Big Data Engineer

    5 days ago

    Pune, Maharashtra, India Capco Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Big Data EngineerAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking,...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionKey Responsibilities:Design and develop data ingestion pipelines.Work on ETL/ELT processes for large-scale data systems.Good experince in Machine LearningCollaborate with cross-functional teams to ensure data quality and performance.Required Skills:PythonETLDatabricksPySparkSQLMachine LearningWorks in the area of Software Engineering, which...

  • Data Science Engineer

    6 days ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Digital Placement Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Primary – Scala with Spark Hdfs  ,Spark with scala , Scala  (Functional Programming ), Hbase , Sql , Sqoop ,Shell Script Optional  :     Apache  Kafka , Akka Http , TeamCity , U-deploy ,  Autosys , SBT Good to have  :     Pivotal Gemfire 7+ years of strong experience as big data developer. Hands on knowledge of Shell Scripting. Familiar with...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Ashra Technology Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Gretting of dayWe are HiringRole: Big Data EngineerExp: 7+YearsLocations: Noida and Gurugram8+ years of overall IT experience, which includes hands on experience in Big Data technologies.Mandatory - Hands on experience in Python and PySpark.Build pySpark applications using Spark Dataframes in Python.Worked on optimizing spark jobs that processes huge volumes...