Senior Data Engineer

20 hours ago

Pune, Maharashtra, India Populace World Solutions Full time ₹ 8,00,000 - ₹ 20,00,000 per year

Description :

Location : Pune (Kharadi), India

Experience : 8 Years

About the Role :

We are seeking a highly skilled and experienced Senior Data Engineer to join our team in Pune. This role is crucial for designing, building, and optimizing our large-scale data processing systems and platforms. As a senior member of the team, you will apply your deep expertise in Python, PySpark, Databricks, and the AWS data ecosystem to solve complex data challenges and drive the next generation of our data infrastructure.

Key Responsibilities :

- Data Pipeline Development : Lead the design, construction, and maintenance of robust, scalable, and high-performance Big Data pipelines using Python and PySpark.

- Big Data Engineering : Apply 8 years of experience as a Big Data Engineer to architect and manage solutions using core technologies like Hadoop and Apache Spark.

- Cloud & Platform Management : Serve as a subject matter expert for the Databricks platform, effectively leveraging its capabilities for data processing, governance, and model deployment.

- Data Structuring & Optimization : Implement and optimize data storage solutions, with extensive experience required in utilizing Delta Tables and working proficiently with JSON and Parquet file formats.

- Problem Solving : Tackle and resolve complex data processing, transformation, and integration problems, ensuring data quality, reliability, and low latency across all systems.

- Database Integration : Utilize a solid working knowledge of NoSQL and RDBMS databases for efficient data ingestion, storage, and retrieval strategies.

- Collaboration & Communication : Leverage good communication skills to effectively collaborate with cross-functional teams, including Data Scientists, Analysts, and other engineering groups, to understand requirements and deliver technical solutions.

Required Qualifications :

- Experience : 8 years of professional experience as a Big Data Engineer or in a deeply related data engineering role.

- Programming Proficiency : Must be proficient with Python & PySpark.

- Core Big Data : In-depth, practical knowledge of Hadoop and Apache Spark.

- Data Lake/Warehouse Technologies : Extensive hands-on experience with Databricks and expert-level usage of Delta Tables.

- File Formats : Must have extensive experience working with and optimizing data stored in JSON and Parquet file formats.

- Cloud & Ecosystem : In-depth knowledge of AWS data analytics services.

- Database Knowledge : Solid working Knowledge of NoSQL and RDBMS databases.

- Problem Solving : Proven ability to analyze and solve complex data processing, transformation, and optimization related problems.

Good-to-Have Qualifications :

- AWS Data Services : Hands-on experience with specific AWS data analytics services like Athena, Glue, Redshift, and EMR.

- Data Warehousing : Familiarity with Data Warehousing concepts and best practices.

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Senior Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time US$ 1,20,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NCSI Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data Engineer Company Name: NCSi Job Description: NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Vanderlande Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job TitleSenior Data EngineerJob DescriptionIf you are passionate about unlocking the power to gain next level insights into a great variety of data, powering data driven decision making through advanced analytics and data science practises, you might have just found your perfect next career step.In this job you will have versatile responsibilities,...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India True Talents Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title :Senior Data EngineerLocation :Pune / NoidaExperience :4 - 8 YearsEmployment Type :Full-timeNotice Period :Up to 30 DaysAbout The RoleWe are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate should have strong expertise in modern data engineering tools,...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NCS Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data EngineerCompany Name: NCSiJob Description:NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to understand...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India HyrEzy Talent Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role : Senior Data Engineer (Snowflake)Location : Pune/ HyderabadExperience : 3 - 6 Years Work model : WFO onlyNotice period : Only 15 days or lessAbout company : We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking and AI-native execution to help...

  • Senior QA Engineer

    1 week ago

    Pune, Maharashtra, India ICE Data Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    The Senior QA Engineer will be responsible for ensuring complete test coverage of data platform and product functionality, development, and maintenance of comprehensive test automation infrastructure, helping with debugging and validating fixes for production issue. This role is responsible for performing a variety of QA engineering tasks including design...