Big Data Engineer

4 weeks ago


Bangalore, India Talpro Full time

Job Description :


Key Responsibilities :

- Develop and maintain scalable data pipelines using Python, PySpark, and Scala.

- Work with Big Data streaming services such as Kinesis, Kafka, and others to process and analyze large data sets.

- Manage and optimize NoSQL data stores such as HBase and DynamoDB.

- Utilize Hadoop and Big Data processing frameworks like Spark, Hive, Nifi, Spark-Streaming, and Flink for data processing and transformation.

- Collaborate with cross-functional teams to participate in key business, architectural, and technical decisions.

- Write and optimize complex SQL queries and use SQL analytical functions for data analysis.

Qualifications :

- Industry Experience : 5+ years, including 3+ years of relevant experience in Big Data technologies.

- Programming Skills : Proficient in Python, PySpark, and Scala (preferred).

- Big Data Tools : Experience with Big Data streaming services (Kinesis, Kafka) and processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink).

- Database Skills : Experience with NoSQL data stores (HBase, DynamoDB) and SQL databases with strong SQL analytical skills.

- Problem-Solving : Ability to participate in and contribute to key business, architectural, and technical decisions.

Additional Requirements :

- Strong communication and collaboration skills.

- Ability to work in a fast-paced, dynamic environment.

- Early joiners who can start in May are preferred

(ref:hirist.tech)
  • Big Data Engineer

    1 month ago


    Bangalore, India Draup Full time

    Job Title: Big Data EngineerAbout the Role:The Big Data Engineer at Draup is responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis. This role involves building generic and reusable data platforms and pipelines. You will work with a team of experienced developers, engineers, and product...

  • Big Data Engineer

    1 month ago


    Bangalore, India Rigel networks Full time

    Job Title: Big Data EngineerJob Description:At Rigel Networks, we are seeking a highly skilled Big Data Engineer to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing big data systems using PySpark, database migration, transformation, and integration solutions for data warehousing projects.Key...

  • Big Data Engineer

    1 month ago


    Bangalore, India Talpro Full time

    Job Title: Big Data EngineerAt Talpro, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using Python, PySpark, and...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Draup Full time

    Role : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for designing, implementing, and maintaining scalable techniques and processes for data storage, transformations, and analysis. This role involves working with a proficient team of developers, engineers, and product team to shape up the data products. The ideal candidate...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Madhees Techno Consulting Pvt. Ltd Full time

    Job Title: Senior Data Engineer at Madhees Techno Consulting Pvt. LtdAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing scalable and efficient big data solutions using Spark, Scala, and other relevant...

  • Big Data Engineer

    1 month ago


    Bangalore, India MaimsD Technology Full time

    About the Role:At MaimsD Technology, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining applications that process and analyze large datasets. You will work closely with data analysts, data scientists, and other team members to...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Talpro Full time

    Job Title: Big Data EngineerJob Summary:Talpro is seeking an experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines using Python, PySpark, and Scala.Key Responsibilities:Develop and maintain scalable data pipelines using Python, PySpark, and Scala.Work...

  • Big Data Engineer

    1 month ago


    Bangalore, India TekPillar Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer to join our team at TekPillar. The ideal candidate will have a strong background in big data tools, programming languages, and cloud experience.Key ResponsibilitiesDesign and implement large-scale data engineering initiativesLead a team of engineers in the development and deployment of data...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Aritha Consulting Services Pvt. Ltd. Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to join our team at Aritha Consulting Services Pvt. Ltd. as a key member of our data engineering group. The successful candidate will be responsible for designing and implementing scalable data pipelines to support our growing business needs.Key Responsibilities:Design and develop...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2This role involves translating client requirements into technical design and implementing data engineering solutions. You will utilize deep understanding of data integration and big data design principles to create custom solutions or implement package solutions. Your key responsibilities will include data ingestion,...

  • Data Engineer

    4 weeks ago


    Bangalore, India Rigel networks Full time

    Job Title - Data Engineer - Big Data SystemsAt Rigel networks, we are seeking a highly skilled Data Engineer to lead the design and implementation of our Big Data systems using PySpark. The ideal candidate will have excellent knowledge in Apache Spark and Python programming experience, as well as deep experience in developing data processing tasks using...

  • Big data Engineer

    7 days ago


    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Big Data Engineer

    2 weeks ago


    bangalore, India Eximietas Design Full time

    6+ yearsof experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience inJava● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of data...

  • Big Data Engineer

    2 weeks ago


    bangalore, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management. ● Strong development experience in Java ● Hands-on experience with Kafka , S3, CDC, Spark, and SQL. ● Proficient with container technologies like Docker. ● Experience working in cloud environments and handling large datasets. ● Solid understanding...

  • Big Data Developer

    3 weeks ago


    bangalore, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ yearsEmployment Type: Full-timeEmployment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have...


  • Bangalore, India TekPillar Full time

    Job Title: Big Data Engineer/LeadAbout the Role:We are seeking a highly skilled Big Data Engineer/Lead to join our dynamic team in Bangalore. As a key member of our data engineering initiatives, you will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.Key Responsibilities:•...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...

  • Big Data Engineer

    1 week ago


    bangalore, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management. ● Strong development experience in Java ● Hands-on experience with Kafka , S3, CDC, Spark, and SQL. ● Proficient with container technologies like Docker. ● Experience working in cloud environments and handling large datasets. ● Solid understanding...

  • Big Data Engineer

    2 weeks ago


    Bangalore, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management. ● Strong development experience in Java ● Hands-on experience with Kafka , S3, CDC, Spark, and SQL. ● Proficient with container technologies like Docker. ● Experience working in cloud environments and handling large datasets. ● Solid...

  • Big Data Engineer

    4 weeks ago


    Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full time

    Job Title: Senior Scala Developer for Big DataLocation: Type: Full-TimeJob Overview:We are seeking a highly skilled Senior Scala Developer for Big Data to lead our team in designing, developing, and optimizing data processing pipelines using Apache Spark. The ideal candidate will have a deep understanding of big data technologies and strong programming...