Data Engineer

4 weeks ago

Pune, India Ascentt Full time

We are looking for Data Engineer with 3-7+ years of experience in production environment.

Must Have

  • Spark Developer with experience in large scale production deployment, data pipeline and large scale computation.
  • Experience in using programming languages such as Scala, Python (PySpark) to mine and query data for analysis and sometimes use big data SQL engines.
  • Develop data set processes for data modeling, mining and production.
  • Create Scala/Spark jobs for data transformation and aggregation.
  • Working experience with AWS services such as EMR, Athena, Glue, Redshift and Lambda.
  • Experience in developing and deploying Databricks jobs with knowledge in optimizing cluster

configurations.

  • Responsible for the maintenance, improvement, cleaning, and manipulation of data in the

business operational and analytics databases.

  • Defines and builds the data pipelines that will enable faster, better, data-informed decision-making within the business.
  • Designing and developing scalable ETL packages from the business source systems and the development of ETL routines in order to populate databases from sources and also to create aggregates.


Nice to Have


  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
  • Experience with Apache Spark streaming and batch framework.
  • Experience with Kafka, Storm, Zookeeper.
  • Spark query tuning and performance optimization.
  • Produce unit tests for Spark transformations and helper methods.
  • Recommend ways to improve data reliability, efficiency and quality.

  • Senior Data Engineer

    3 days ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Senior Data Scientist

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Software Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Software Engineer

    2 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Software Engineer

    4 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Software Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • IT Systems Administrator

    4 weeks ago

    Pune, India ENGINEER HORIZON Full time

    Provide technical support for both hardware and software issues our users encounter - Manage the configuration and operation of computer operating systems - Monitor the system daily and respond immediately to security or usability concerns - Create and verify backups of data - Respond to and resolve help desk requests - Upgrade systems and processes as...

  • Data Engineer

    5 days ago

    Pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems.Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI.Ensure systems meet business requirements and industry practices by...

  • Data Engineer

    1 week ago

    pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems.  Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI.  Ensure systems meet business requirements and industry practices by...

  • Data Engineer

    1 week ago

    Pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems. Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI. Ensure systems meet business requirements and industry practices by...

  • Data Engineer

    2 weeks ago

    pune, India Synechron Full time

    Good day,We have immediate opportunity for Data Analytics Engineer.Job Role: Data Analytics EngineerJob Location: Kharadi, PuneExperience- 8 Years to 12 Years.Notice Period: upto 30 days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative...

  • Senior Software Engineer – Fullstack

    3 weeks ago

    Pune, India Crest Data Systems Full time

    Job Description:We are looking for software engineers to join our engineering team in Ahmedabad & Pune. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security, and Cloud segments. The job requires an understanding of backend & frontend programming languages such as Core...

  • Data Engineer

    2 weeks ago

    Pune, India Sigmaways Inc Full time

    This position is a Hybrid Role candidate should be 2 days onsite in Pune Office ( Prefer Local candidates).Position : Data EngineerType : Long Term Contract RoleLocation : Pune / HybridJob Description:1. This position is for Data warehouse group .2. This position is a Data Engineer position but someone with hands on strong in programming language .3. Someone...

  • Data Engineer

    2 weeks ago

    Pune, India Synechron Full time

    Good day,We have immediate opportunity for Data Analytics Engineer.Job Role:Data Analytics EngineerJob Location:Kharadi, PuneExperience-8 Years to 12 Years.Notice Period:upto 30 days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology...

  • Data Engineer

    2 weeks ago

    Pune, India Synechron Full time

    Good day,We have immediate opportunity for Data Analytics Engineer.Job Role:Data Analytics EngineerJob Location:Kharadi, PuneExperience-8 Years to 12 Years.Notice Period:upto 30 days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology...

  • Data Engineer

    2 weeks ago

    pune, India Tech Mahindra Full time

    Title: Reltio GCP Data EngineerLocation: PuneExperience: 6+yearsNP: Immediate to 15daysCompany Profile:Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create sustainable businesses that can bring about lasting change in our communities – to create an equal...

  • Data Engineer

    2 weeks ago

    Pune, India Sigmaways Inc Full time

    This position is a Hybrid Role candidate should be 2 days onsite in Pune Office ( Prefer Local candidates). Position : Data Engineer Type : Long Term Contract Role Location : Pune / Hybrid Job Description: This position is for Data warehouse group . This position is a Data Engineer position but someone with hands on strong in programming language . Someone...