Big Data Engineer

4 weeks ago


Bangalore, India Tavant Full time

Key Responsibilities :

- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.

- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.

- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and deliver innovative data solutions.

- Optimize Spark jobs for performance and cost efficiency across large datasets.

- Ensure high data quality and integrity by implementing robust testing and validation practices.

- Lead the adoption of best practices in code quality, CI/CD, and DevOps within the data engineering team.

- Mentor junior developers and contribute to knowledge sharing and team development.

Required Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- At least 7 years of software development experience, with a minimum of 5 years focused on big data processing using Apache Spark and Java.

- Proficient in Java programming and familiar with the Scala programming language.

- Strong experience in designing and implementing scalable data processing pipelines using Apache Spark and Java.

- Solid understanding of big data technologies and ecosystems (HDFS, YARN, Kafka, HBase, etc.).

- Experience with cloud platforms (AWS, Azure, or GCP) and understanding of cloud-native services for data processing.

- Familiarity with DevOps tools and practices, including Docker, Kubernetes, Jenkins, and Git.

- Excellent problem-solving skills, with the ability to tackle challenges in large-scale data environments.

- Strong communication and collaboration skills, with the ability to work effectively in a team and interface with technical and non-technical stakeholders.

(ref:hirist.tech)
  • Big data Engineer

    1 month ago


    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Data Engineer

    4 weeks ago


    Bangalore, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...


  • Bangalore, India Lakshya Software Technologies Pvt. Ltd. Full time

    Title: Cloud Big Data Engineer Exp - 5+ years Location: Anywhere in India Work Mode: HYBRID Mandatory Skills required: Big Data (Hadoop, Hive), Python, Spark, Py Spark, Cloud Platform, Azure Job description: Understanding of Big data Ecosystem with hands on experience working on Apache Spark, Hadoop (HDFS , Hive), Parquet, Elastic Search ...

  • Big Data Engineer

    1 month ago


    Bangalore, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management. ● Strong development experience in Java ● Hands-on experience with Kafka , S3, CDC, Spark, and SQL. ● Proficient with container technologies like Docker. ● Experience working in cloud environments and handling large datasets. ● Solid...

  • Big data engineer

    2 weeks ago


    Bangalore, India Capco Full time

    Job Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients...


  • Bangalore, India FxConsulting Full time

    Job Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities : - Design,...


  • Bangalore, India Lakshya Software Technologies Pvt. Ltd. Full time

    Title: Cloud Big Data Engineer Exp - 5+ years Location: Anywhere in India Work Mode: HYBRID Mandatory Skills required: Big Data (Hadoop, Hive), Python, Spark, PySpark, Cloud Platform, Azure Job description: Understanding of Big data Ecosystem with hands on experience working on Apache Spark, Hadoop (HDFS , Hive), Parquet, Elastic Search ...

  • Big data developer

    2 weeks ago


    Bangalore, India Impetus Full time

    Big Data Developer Experience- 3 to 12 years Locations- Indore, Noida, Hyderabad, Bangalore, Gurgaon Job Description We are looking for a Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets. Roles &...

  • Big Data Engineer

    2 weeks ago


    Bangalore, India Capco Full time

    Job Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+...

  • Solution Engineer

    4 weeks ago


    Bangalore, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...


  • Bangalore/Remote, India Skima Innovations Pvt ltd Full time

    About the Company : We are a stealth company revolutionizing the marketing landscape with our AI-powered platform. Our team has pioneered AI-based marketing systems at some of the most iconic companies in the world including Expedia, Amazon, Snapchat, and BCG to transform how businesses direct their marketing spend to drive unprecedented growth and...


  • Bangalore, India Damco Solutions Full time

    Position – Big Data Engineer with Devops Exp - 6-10 Yrs Job Location- Bangalore ( 3 days hybrid working ) Job Description As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate...


  • Bangalore, India Prodapt Full time

    Roles and Responsibilities: Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in Big Query or Data Proc platforms. Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc. Grant access to BQ datasets, GCS buckets and Hive...

  • Big Data Developer

    1 month ago


    Bangalore, India LTIMindtree Full time

    Please fill this form for quick responses ;- If it is not able to access please past it on Google and try to fill it... Link:- Role:- Big Data Developer/ Big Data Engineer Skills:- Pyspark, Sql, Hive, Exp:- 5 + Years Loc:- Bengaluru, NCR Noida, Gurugram, Delhi Mode;- Hybrid Regards, Dhamodhar. G TA


  • Bangalore, India Draup Full time

    Role : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for building scalable techniques and processes for data storage, transformations, and analysis. The role includes designing, and implementation of the optimal, generic, and reusable data-platforms and pipelines. You will work with a very proficient, inquisitive,...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, India Visionyle Solutions Full time

    Title : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...

  • Big Data Developer

    3 months ago


    Bangalore City, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data DeveloperDesired Experience: 5+ YearsJob Location: Chennai/ Bangalore / Pune / MumbaiRequire skillset: Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications: Data Engineer CertificationExperience with Apache Beam.Technical...

  • Big data specialist

    2 weeks ago


    Bangalore, India LTIMindtree Full time

    Please fill this form for quick response:- Please fill this: - if it is not opening you can paste it on google and fill it. Experience Range - 5 to 12 yrs Skills - Big Data- Scala Spark Job Location: Bangalore, Chennai, Pune, Hyderabad, Mumbai Scala Spark Job Description: Mainly Scala+Spark ex perience needed. 5+ years of experience ...

  • Big Data Developer

    3 months ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data DeveloperDesired Experience: 5+ YearsJob Location: Chennai/ Bangalore / Pune / MumbaiRequire skillset: Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications: Data Engineer CertificationExperience with Apache Beam.Technical...

  • Big Data Developer

    1 week ago


    Bangalore Urban, India Recro Full time

    Job Title: Big Data Engineer (Python & PySpark)Location: BangaloreExperience: 5+ yearsKey Responsibilities:Develop scalable data pipelines using Python and PySpark.Build and optimize Apache Spark jobs for data transformation and aggregation.Work with Big Data tools: Hadoop, HDFS, Hive, Kafka, and large datasets.Implement cloud-based solutions on Google Cloud...