Senior Data Engineer

4 days ago


Mumbai Pune, India Iquest Management Consultants Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Job Title: Senior Data Engineer

Experience: 8+ Years

Location : Pune & Mumbai

Employment Type: Full-time

Job Description:

We are looking for a Senior Data Engineer who is responsible for the design and development of scalable data pipelines and integrations to support continual increases in data volume and complexity. Work with analytics and business teams to understand their needs, create pipelines, improve data models that feed BI and visualization tools.

Key Responsibilities:

Data Pipeline Development: Design, develop, and maintain robust ETL pipelines to move data from source systems to our data storage platforms. This includes data ingestion, transformation, and data quality checks to ensure accuracy and completeness.

Data Modeling: Create and maintain data models and schemas that support business analytics, reporting, and data visualization requirements. Optimize data structures for performance and scalability.

Data Integration: Integrate data from various internal and external sources, including databases, APIs, flat files, and streaming data sources. Ensure seamless data flow across systems and platforms.

Performance Optimization: Identify and address performance bottlenecks in data pipelines and database systems. Implement optimizations to improve data processing speed, scalability, and efficiency.

Data Quality and Governance: Implement data quality checks, validation rules, and data governance policies to maintain the integrity and reliability of our data assets. Monitor data quality metrics and take proactive measures to address issues.

Collaboration: Work closely with data analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Collaborate with IT teams to ensure alignment with overall technology architecture and standards.

Documentation and Best Practices: Document data pipelines, data models, and technical specifications. Follow best practices for software development, version control, and deployment processes.

Continuous Improvement: Stay abreast of industry trends, emerging technologies, and best practices in data engineering. Identify opportunities for process improvement and automation to streamline data workflows and increase productivity.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • 8+ years of experience in data engineering or related roles.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong SQL skills and experience with relational databases (e.g., MySQL, PostgreSQL).
  • Experience with data warehousing concepts and technologies (e.g., Snowflake, Redshift).
  • Familiarity with big data processing frameworks (e.g., Apache Spark, Hadoop).
  • Hands-on experience with ETL tools and data integration platforms.
  • Knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Understanding of data modeling principles and data warehousing design patterns.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

  • Senior Data Engineer

    2 weeks ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    4 weeks ago


    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Senior Data Engineer

    2 weeks ago


    Mumbai, Pune, India Go Digital Technology Consulting Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Senior Data EngineerLocation: Mumbai & PuneExperience: 3yrs to 8yrsTechnologies / Skills: Advanced SQL, Python and associated libraries like Pandas, NumPy etc., Pyspark , Shell scripting, Data-Modelling, Big data, Hadoop, Hive, ETL pipelines.Responsibilities: • Proven success in communicating with users, other technical teams, andsenior management to...

  • Senior Data Engineer

    2 weeks ago


    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...


  • Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...

  • Senior Data Engineer

    2 weeks ago


    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    2 weeks ago


    pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    2 weeks ago


    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    2 weeks ago


    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...


  • Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...