Data Engineer for Large-Scale Data Systems

2 weeks ago


Pune, Maharashtra, India Advent Global Solution Private Limited Full time

Job Description:

We are seeking an experienced Data Engineer to join our team at Advent Global Solution Private Limited.

The ideal candidate will have a strong background in designing, developing, and maintaining large-scale data systems using Python, Scala, SQL, and Unix scripting.

Key Responsibilities:

  • Develop and maintain architectures such as databases and large-scale processing systems.
  • Utilize Big Data technologies including Hadoop, Hive, Hbase, and Spark to manage and manipulate large data sets.
  • Write and optimize SQL and HQL for database management and data manipulation.
  • Implement coding best practices to maintain software quality and readability.
  • Optimize queries and tune performance for Hive and Spark applications.

Requirements:

  • A minimum of 5-7 years of industry experience in data engineering.
  • Strong programming skills with at least 5 years of experience in Python, Scala, and SQL.
  • Expertise in Big Data technologies such as Hadoop, Hive, Hbase, and Spark.
  • Proficiency in Unix scripting with a minimum of 5 years of experience.
  • Deep knowledge of SQL and HQL.
  • Solid understanding of coding best practices.
  • Experience in query optimization and performance tuning, particularly for Hive and Spark.

Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum.



  • Pune, Maharashtra, India PRI Global Full time

    At PRI Global, we are seeking a seasoned Data Engineer to lead our efforts in designing and optimizing large-scale data systems. With a strong focus on innovation and collaboration, this role offers the perfect blend of technical challenge and professional growth.Job Title: Senior Data EngineerLocation: Pune, IndiaOverview:We require a highly skilled Data...


  • Pune, Maharashtra, India Evnek Technologies Full time

    Evnek Technologies is seeking an experienced Data Engineer with a strong background in SQL and PySpark to design, develop, and maintain large scale data infrastructure.Job OverviewThe ideal candidate will have at least 5 years of experience working with Azure cloud services and be proficient in writing complex SQL queries and optimizing performance. They...


  • Pune, Maharashtra, India Sibros Full time

    Accelerating the Future of SDV ExcellenceSibros' Deep Connected Platform empowers the automotive industry by providing seamless software update management, vehicle analytics, and remote commands in a single platform.Job DescriptionWe are seeking a highly skilled Software Engineer II to join our team in Pune, India. This role involves tackling challenging...


  • Pune, Maharashtra, India Lear Corporation Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Lear Corporation. This role will be responsible for designing, building, and maintaining large-scale data pipelines within Palantir Foundry.About the RoleIn this position, you will collaborate with cross-functional teams to ensure data solutions are robust, reliable, and...


  • Pune, Maharashtra, India Advent Global Solution Private Limited Full time

    Job DescriptionWe are seeking a highly skilled Data Processing Systems Engineer to join our team at Advent Global Solution Private Limited. The ideal candidate will have a strong background in data engineering, with expertise in designing, developing, and maintaining large-scale data processing systems.The successful candidate will have experience in...

  • Data Systems Engineer

    2 months ago


    Pune, Maharashtra, India Rohini IT Consulting LLP Full time

    Rohini IT Consulting LLP seeks a highly skilled Data Systems Engineer to design, implement, and maintain large-scale data processing systems.Key Responsibilities:- Design and develop scalable data pipelines using Star/Snowflake schema design and data modeling.- Collaborate with cross-functional teams to implement data warehouse technologies (e.g., Snowflake,...


  • Pune, Maharashtra, India IntraEdge Full time

    About IntraEdge">IntraEdge is a Technology, Products and Learning Organization founded in 2002 with offices across the globe.We provide our clients with resources and expertise to enhance business performance through technology.">Job Description">As a Senior Python Engineer at IntraEdge, you will leverage cutting-edge technologies to drive business insights....


  • Pune, Maharashtra, India IntraEdge Full time

    About the RoleWe are seeking a highly skilled Senior Python Engineer to join our team at Intraedge. As a key member of our technical team, you will be responsible for designing and implementing large-scale systems that meet the needs of our clients.Key ResponsibilitiesDesign and develop scalable and efficient software solutions using Python and related...


  • Pune, Maharashtra, India Luxoft Full time

    About This RoleLuxoft is seeking an experienced Senior DevOps Engineer to join our team. As a key member of our organization, you will be responsible for ensuring the smooth operation of our large-scale IT systems.Our ideal candidate will have a minimum of 5 years of experience in DevOps technology tools and automation capabilities, with a proven track...


  • Pune, Maharashtra, India Ilink Systems Pvt Ltd Full time

    About Ilink Systems Pvt Ltd:Ilink Systems Pvt Ltd is a technology-driven company that requires a highly skilled Azure Data Solutions Engineer to lead its cloud transformation and operations initiatives. The successful candidate will have a strong background in designing and implementing data lakes using Azure services.Job Description:The Azure Data Solutions...


  • Pune, Maharashtra, India Delphix Software Private Limited Full time

    About the RoleDelphix Software Private Limited is seeking an experienced Enterprise Software Architect to join its Continuous Data team in India. This role requires strong experience in analyzing, debugging, and diagnosing complex software systems.Main Responsibilities:Architect, design, and implement large-scale components of the product to drive innovation...


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...


  • Pune, Maharashtra, India Persistent Systems Full time

    Persistent Systems is seeking an experienced Data Processing Expert to join our team in developing a scalable data processing platform. This challenging role requires expertise in Python development and distributed database systems, as well as strong knowledge of MongoDB/Document DB and Elasticsearch implementation and optimization.The ideal candidate will...

  • Cloud Data Engineer

    8 hours ago


    Pune, Maharashtra, India Ubique Systems Full time

    At Ubique Systems, we're seeking an experienced Data Engineer to join our team. As a cloud-first organization, we're committed to harnessing the power of cutting-edge technologies to drive innovation and excellence.We're offering a highly competitive salary of $120,000-$180,000 per annum, depending on experience, to lead our data engineering efforts. If...


  • Pune, Maharashtra, India JetSynthesys Full time

    Job DescriptionWe are seeking an experienced Senior Backend Engineer to lead the development and maintenance of our large-scale multiplayer game's server-side logic. The ideal candidate will have a strong background in Python, Google App Engine (GAE), and deploy/build automation using Jenkins or similar tools.About the RoleArchitect and manage the underlying...


  • Pune, Maharashtra, India IntraEdge Full time

    About IntraEdgeIntraEdge is a Technology, Products and Learning Organization founded in 2002 with offices across the globe.What We OfferA competitive estimated salary of $140,000 - $160,000 per year for this role, depending on experience and qualifications.Job DescriptionWe are seeking a skilled Senior Python Engineer to join our dynamic team. This position...

  • Chief Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Uddyam People Full time

    Join Our TeamWe are seeking an experienced Chief Data Engineer to join our team at Uddyam People. As a key member of our organization, you will be responsible for designing and implementing large-scale data architectures that meet the complex needs of our clients in the Finance sector. You will also lead the development of data engineering capabilities to...


  • Pune, Maharashtra, India Luxoft Full time

    Luxoft, a leading provider of innovative software development services and solutions, is seeking a highly skilled Technical Architect to lead the development of large-scale enterprise software systems.As a key member of our team, you will be responsible for reengineering existing applications and introducing additional application interface layers to enable...


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data DynamicsWe are a forward-thinking organization seeking a highly skilled Data Science Expert for Machine Learning and NLP to join our team. As a key member of our data science division, you will be responsible for developing and deploying innovative machine learning models to drive business growth.Estimated Salary: $140,000 - $180,000 per yearJob...


  • Pune, Maharashtra, India JetSynthesys Full time

    Job Description:    We are seeking a highly skilled Senior Backend Engineer to lead the development and maintenance of our server-side logic for a large-scale, globally serviced multiplayer Real-Time Strategy (RTS) game. As a key member of our engineering team, you will be responsible for architecting and managing the underlying infrastructure components...