Senior Big Data Engineer

2 months ago


Bangalore, India Eximietas Design Full time

About Eximietas:

Eximietas, a technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, VLSI, Embedded Software, and Artificial Intelligence, Eximietas is dedicated to empowering businesses with cutting-edge innovations, ensuring their digital future is secure, efficient, and poised for growth. We foster a vibrant and collaborative work culture that thrives on innovation and inclusivity. Rooted in the spirit of Silicon Valley's tech dynamism, our global teams are united by a passion for excellence in technology and engineering.

Position: Data Engineer

Job Type: Full-time

Location: Bengaluru

Job Description:

We are seeking a skilled Data Engineer with over 4 years of experience in data engineering and development expertise in Java . The ideal candidate will have hands-on experience in designing, building, and maintaining data pipelines, as well as working with a wide range of data technologies, including Kafka, S3, CDC (Change Data Capture), Spark, and SQL. The candidate should also be proficient in container technologies like Docker and have a strong understanding of best practices for scalable and efficient data processing.

Responsibilities:

● Design, develop, and maintain robust data pipelines using a combination of Java and relevant data technologies.

● Implement and manage real-time data streaming using Kafka and CDC processes to ensure efficient data flow.

● Work with S3 for scalable storage solutions and manage the integration with data pipelines.

● Develop and optimize big data processing using Spark for distributed data processing and SQL for querying.

● Ensure smooth setup and maintenance of containerized environments using Docker.

● Collaborate with cross-functional teams to understand data needs and provide data solutions that align with business requirements.

● Troubleshoot and resolve issues in existing pipelines and ensure data quality and integrity.

● Stay up-to-date with the latest industry trends in data engineering and recommend best practices.

Required Skills and Qualifications:

● 4+ years of experience in data engineering with a focus on data pipeline setup and management.

● Strong development experience in Java .

● Hands-on experience with Kafka, S3, CDC, Spark, and SQL.

● Proficient with container technologies like Docker.

● Experience working in cloud environments and handling large datasets.

● Solid understanding of data architecture and real-time processing.

● Strong problem-solving skills and the ability to work independently as well as part of a team


  • Senior Data Engineer

    1 month ago


    Bangalore, India Visionyle Solutions Full time

    Title : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...


  • Bangalore, India FxConsulting Full time

    Job Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities : - Design,...


  • Chennai/Bangalore, India FinJo Full time

    Job DescriptionFinJo is seeking a seasoned Data Engineer to join our team.About the RoleWe are looking for a skilled professional with at least 7 years of experience in big data technologies to lead our data engineering efforts. As a Senior Big Data Architect, you will be responsible for designing, developing, and maintaining large-scale data processing...


  • bangalore, India Eximietas Design Full time

    About Eximietas:a technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, VLSI, Embedded Software, and Artificial Intelligence, Eximietas is dedicated to empowering businesses with cutting-edge innovations,...


  • Bangalore, India Publicis Sapient Full time

    Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile...


  • Bangalore, India Publicis Sapient Full time

    Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile...

  • Data Engineer

    1 month ago


    Bangalore, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...


  • bangalore, India Publicis Sapient Full time

    Company DescriptionPublicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering...


  • Bangalore, India Lakshya Software Technologies Pvt. Ltd. Full time

    Title: Cloud Big Data Engineer Exp - 5+ years Location: Anywhere in India Work Mode: HYBRID Mandatory Skills required: Big Data (Hadoop, Hive), Python, Spark, Py Spark, Cloud Platform, Azure Job description: Understanding of Big data Ecosystem with hands on experience working on Apache Spark, Hadoop (HDFS , Hive), Parquet, Elastic Search ...

  • Big Data Engineer

    2 months ago


    Bangalore, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management. ● Strong development experience in Java ● Hands-on experience with Kafka , S3, CDC, Spark, and SQL. ● Proficient with container technologies like Docker. ● Experience working in cloud environments and handling large datasets. ● Solid...

  • Big data engineer

    2 weeks ago


    Bangalore, India Capco Full time

    Job Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients...


  • Bangalore, India Talpro Full time

    Job Description : Key Responsibilities :Design and Development :- Architect, design, and develop scalable and high-performance data platforms.- Implement data ingestion, transformation, and processing pipelines using technologies such as Apache Kafka, Hadoop, Spark, and Flink.- Develop real-time data processing and stream processing applications.Data...


  • Bangalore, India Lakshya Software Technologies Pvt. Ltd. Full time

    Title: Cloud Big Data Engineer Exp - 5+ years Location: Anywhere in India Work Mode: HYBRID Mandatory Skills required: Big Data (Hadoop, Hive), Python, Spark, PySpark, Cloud Platform, Azure Job description: Understanding of Big data Ecosystem with hands on experience working on Apache Spark, Hadoop (HDFS , Hive), Parquet, Elastic Search ...

  • Big data developer

    2 weeks ago


    Bangalore, India Impetus Full time

    Big Data Developer Experience- 3 to 12 years Locations- Indore, Noida, Hyderabad, Bangalore, Gurgaon Job Description We are looking for a Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets. Roles &...

  • Big Data Engineer

    2 weeks ago


    Bangalore, India Capco Full time

    Job Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+...

  • Solution Engineer

    1 month ago


    Bangalore, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...


  • Bangalore/Remote, India Skima Innovations Pvt ltd Full time

    About the Company : We are a stealth company revolutionizing the marketing landscape with our AI-powered platform. Our team has pioneered AI-based marketing systems at some of the most iconic companies in the world including Expedia, Amazon, Snapchat, and BCG to transform how businesses direct their marketing spend to drive unprecedented growth and...


  • Bangalore, India Damco Solutions Full time

    Position – Big Data Engineer with Devops Exp - 6-10 Yrs Job Location- Bangalore ( 3 days hybrid working ) Job Description As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate...


  • Chennai/Bangalore, India Globalemployees Full time

    About UsGlobalemployees is a cutting-edge technology company that leverages the power of big data to drive innovation.Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a key member of our engineering team, you will design, build, and maintain large-scale data processing systems using cloud-based technologies like...


  • Bangalore, India Prodapt Full time

    Roles and Responsibilities: Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in Big Query or Data Proc platforms. Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc. Grant access to BQ datasets, GCS buckets and Hive...