Big Data Engineer

3 weeks ago


ChennaiPune, IN Pan Asia Man power Consultants Recruiting agency Full time

Job Title : Big Data Engineer

Experience Range : 6+ Years

Location : Chennai/Pune (Hybrid - 2 Days Work From Office in a Week)

Job Description :

We are seeking a skilled Big Data Engineer to join our Agile team and contribute to building backend data applications and services that support our analytics platforms. This role requires a hands-on developer with expertise in various technologies to drive our data initiatives.

Key Responsibilities :

- Function as a core team member within Agile teams to design, develop, and maintain backend data applications and services.

- Collaborate with product owners and team members to gather requirements and discuss implementation strategies for addressing business needs and challenges.

- Partner with business resources to troubleshoot data-related issues, manage capacity, and optimize environments for performance and expansion.

- Participate in cloud migration efforts, utilizing basic knowledge of AWS.

Required Skills :

Scala :


- Strong proficiency in Scala for building scalable data applications.

Spark :


- Expertise in Apache Spark for processing large datasets efficiently.

Python :


- Experience in Python for data manipulation and analytics.

Shell Scripting :


- Proficient in shell scripting for automation and task scheduling.

AWS :


- Basic knowledge of AWS services for cloud integration and migration.

Additional Skills (Preferred) :

Jenkins :


- Experience with Jenkins pipelines for continuous integration and deployment.

Autosys :


- Familiarity with Autosys scheduling tool for job scheduling and management.

Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience in big data technologies and frameworks.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration abilities.

Why Join Us ?

- Work with a dynamic and innovative team.

- Opportunity to contribute to cutting-edge analytics projects.

- Flexible work environment with a hybrid model.

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Bangalore/Pune/Trivandrum/Thiruvananthapuram, IN Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...

  • Big Data Engineer

    3 weeks ago


    Chennai/Bangalore/Hyderabad/Mumbai/Pune/Delhi/Coimbatore, IN Flipped.ai Full time

    Job Description : Big Data Engineer - Scala, SparkAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions. You will...

  • Big Data Engineer

    3 weeks ago


    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, IN GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Description : Big Data Engineer - Scala, SparkYears of exp: 6 to 13 yearsJob location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / CoimbatoreAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be...

  • Big Data Engineer

    3 weeks ago


    Hyderabad/Pune/Delhi NCR, IN Ace Recruit Full time

    Job Description :As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data ingestion...

  • Big Data Engineer

    3 weeks ago


    Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full time

    Job Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...

  • Big Data Engineer

    3 weeks ago


    Chennai/Noida/Gurgaon/Gurugram/Mumbai, IN ANRI Solutions HR Services Full time

    Role : Big Data Engineer Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details : 1. Expertise in Spark framework with scala language and Pyspark 2. Expertise in ETL and Data Warehousing and cloud concepts 3....

  • Big Data Developer

    3 weeks ago


    Hyderabad/Bangalore/Chennai/Bhubaneshwar, IN Rigel networks Full time

    Job Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...


  • Pune/Noida/Hyderabad/Chennai/Bangalore, IN TETRAHED INC Full time

    About the Role : We are seeking a highly skilled Senior Big Data Engineer/Architect to design, develop, and implement robust data solutions on the Google Cloud Platform (GCP). You will be responsible for architecting and building scalable data pipelines, data warehouses, and data lakes to support critical business operations.Responsibilities : - Define and...

  • Big Data Team Lead

    3 weeks ago


    Bangalore/Chennai/Pune, IN Rigel networks Full time

    Job Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...

  • PySpark Developer

    3 weeks ago


    Pune/Bangalore/Chennai/Hyderabad/Mysore, IN Vtricks Technologies Full time

    Job Title : PySpark Developer Location : Pune, Bangalore, Chennai, Hyderabad, MysoreMode of Work : Onsite/HybridNotice Period : Immediate to 10 daysJob Description :We are looking for an experienced PySpark Developer with strong hands-on experience in working with Data Frames and the PySpark development process using Azure services. The ideal candidate...


  • Chennai/Bangalore/Hyderabad, IN Resourcetree Full time

    About the role :As Program Lead - Technology Consulting, you will be key member of the teams working on end-to-end AI and analytics solutions being built for our clients. While your primary focus will be on the data engineering and application engineering components of the overall solution, you will collaborate with internal data science teams for the ML...


  • Bangalore, Pune ,Mumbai,Noida,Chennai,Hyderabad, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full time

    Job Title : Senior Data Integration Engineer (Talend + Azure + Databricks)Location : Bangalore, Pune, Mumbai, Noida, Chennai, HyderabadWorking Hours : 12 PM IST to 9 PM ISTExperience Required : 6 to 8 YearsNotice Period : Immediate to 3 Weeks MaxJob Description :We are seeking a highly skilled Senior Data Integration Engineer with expertise in Talend and...

  • Big Data Developer

    3 weeks ago


    Pune/Gurgaon/Gurugram, IN Talent Toppers LLP Full time

    Responsibilities :- Undertake complete ownership in accomplishing activities and assigned responsibilities across all phases of project lifecycle to solve business problems across one or more client engagements;- Apply appropriate development methodologies (e.g.: agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA...

  • Azure Data Engineer

    3 weeks ago


    Pune/Hyderabad/Bangalore/Chennai, IN BSRI Solutions Full time

    Job Description :We are seeking a talented and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering with a focus on Microsoft Azure services. The candidate should have a minimum of 5-10 years of hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, Synapse Pipelines,...

  • Data Modeler

    3 weeks ago


    Bangalore/Hyderabad/Chennai/Pune, IN Hashone Careers Private Limited Full time

    Role Overview :We are seeking an experienced Data Modeller with a strong foundation in data architecture, modelling, and analysis. The ideal candidate will be proficient in Erwin Data Modelling and have a deep understanding of data quality, data lineage, and data cataloging. You will play a crucial role in designing and optimizing data models for both OLTP...

  • Data Engineer

    1 day ago


    Noida/Bangalore/Chennai/Hyderabad/Coimbatore, IN Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark/Spark/Scala/pysparkJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark,...


  • Bangalore/Chennai/Pune/Mumbai, IN SMARTWORK IT SERVICES Full time

    Job Description : Job Title : Data Scientist (Python). Location : Chennai, Bangalore, Pune, Mumbai. Experience : 9-12 Years. Key Responsibilities : - Analyze large datasets to identify trends, patterns, and insights.- Develop and implement predictive models using machine learning algorithms.- Use Python and related libraries (e.g, Pandas, NumPy,...

  • Data Engineer

    2 weeks ago


    Delhi NCR/Bangalore/Hyderabad/Chennai, IN ANLAGE Full time

    Job Overview : We are seeking a highly skilled and motivated Scala Data Engineer to join our team. In this role, you will design, build, and maintain large-scale data processing systems. The ideal candidate will have a strong background in Scala programming, distributed data processing frameworks, and a deep understanding of data architecture and pipelines....


  • Pune/Gurgaon/Gurugram/Bangalore, IN ZS Full time

    Comapany Description :ZS is a place where passion changes lives. As a management consulting and technology firm focused on transforming global healthcare and beyond, our most valuable asset is our people. Here you'll work side-by-side with a powerful collective of thinkers and experts shZS is a place where passion changes lives. As a management...

  • Azure Data Engineer

    2 weeks ago


    Gurgaon/Gurugram/Mumbai/Pune, IN Techno Wise Full time

    1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and reliability.4. Work closely...