Big Data Engineer

1 month ago


Bangalore, Karnataka, India Talpro Full time

Job Description :


Key Responsibilities :

- Develop and maintain scalable data pipelines using Python, PySpark, and Scala.

- Work with Big Data streaming services such as Kinesis, Kafka, and others to process and analyze large data sets.

- Manage and optimize NoSQL data stores such as HBase and DynamoDB.

- Utilize Hadoop and Big Data processing frameworks like Spark, Hive, Nifi, Spark-Streaming, and Flink for data processing and transformation.

- Collaborate with cross-functional teams to participate in key business, architectural, and technical decisions.

- Write and optimize complex SQL queries and use SQL analytical functions for data analysis.

Qualifications :

- Industry Experience : 5+ years, including 3+ years of relevant experience in Big Data technologies.

- Programming Skills : Proficient in Python, PySpark, and Scala (preferred).

- Big Data Tools : Experience with Big Data streaming services (Kinesis, Kafka) and processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink).

- Database Skills : Experience with NoSQL data stores (HBase, DynamoDB) and SQL databases with strong SQL analytical skills.

- Problem-Solving : Ability to participate in and contribute to key business, architectural, and technical decisions.

Additional Requirements :

- Strong communication and collaboration skills.

- Ability to work in a fast-paced, dynamic environment.

- Early joiners who can start in May are preferred

(ref:hirist.tech)
  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...


  • Bangalore, Karnataka, India FxConsulting Full time

    Job Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities : - Design,...

  • Solution Engineer

    1 month ago


    Bangalore, Karnataka, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...


  • Bangalore, Karnataka, India Draup Full time

    Role : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for building scalable techniques and processes for data storage, transformations, and analysis. The role includes designing, and implementation of the optimal, generic, and reusable data-platforms and pipelines. You will work with a very proficient, inquisitive,...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India Visionyle Solutions Full time

    Title : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...


  • Bangalore, Karnataka, India Talpro Full time

    Job Description :Key Responsibilities :Design and Development :- Architect, design, and develop scalable and high-performance data platforms.- Implement data ingestion, transformation, and processing pipelines using technologies such as Apache Kafka, Hadoop, Spark, and Flink.- Develop real-time data processing and stream processing applications.Data...

  • Big Data Engineer

    1 month ago


    Bangalore, Karnataka, India Tavant Full time

    Key Responsibilities :- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and...

  • Big Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India TekPillar Full time

    Position : Big Data EngineerExperience : 4 to 7 YearsLocation : BangaloreMandatory Skills: Hadoop , Hive , Spark , Python , SQL , AWS/Azure , AirflowJob Description :- 4-6 years of relevant experience with a bachelor's degree- Exposure to Satellite/Telecom industries- Proven leadership in large data engineering initiatives- Proficiency in Big Data tools...

  • Platform Architect

    4 months ago


    Bangalore, Karnataka, India Talpro Full time

    Educational Qualification : - BE./ B.Tech., M./M.Tech. or M.Sc. in Computer Science from Tier 1 university Skill Set :- 10+ years of experience in end-to-end software development and system architecture, preferably in a product development organisation- Hands-on experience in Java and Big Data tech stack - Apache Pinot/Druid/Hudi, HDFS, Hive, Presto, Flume,...

  • Big Data Engineer

    1 month ago


    Bangalore, Karnataka, India TEAMLEASE DIGITAL PRIVATE LIMITED Full time

    Job Title : Data EngineerLocation : Bangalore / HyderabadJob Type : Full-timeWork Arrangement : 4 days a week in the office, 1 day remoteExperience Level : 4+ yearsRole Overview : We are seeking an experienced Data Engineer with a strong background in Hadoop, MapReduce, and Java. The ideal candidate will have a proven track record of handling large-scale...


  • Bangalore, Karnataka, India TekPillar Full time

    Join our dynamic team in Bangalore as a Big Data Engineer contribute to our key data engineering initiatives! You will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.Job Title : Big Data Engineer/ LeadExperience : 4 to 9 YearsLocation : BangaloreKey Responsibilities : - Collaborate...


  • Bangalore, Karnataka, India Altimetrik Full time

    Role : Data engineer - Good understanding of AWS Data Stack including services like S3, Redshift, EMR, Lambda, Athena and Glue. Good understanding of Hadoop/HDFS- Designing and developing ETL jobs across multiple platforms- Designing and developing schema definitions and support data warehouse/mart to enable integration of disparate data sources from within...

  • Big Data Engineer

    1 month ago


    Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    This position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding. Experience : 4-7 Years. Location :...

  • Big Data Engineer

    1 month ago


    Bangalore, Karnataka, India MaimsD Technology Full time

    Job Title : Big Data DeveloperExperience : 4-7 yearsLocation : BengaluruJob Type : Full-TimeJob Description : About the Role : As a Big Data Developer, you will be responsible for designing, developing, and maintaining applications that process and analyze large datasets. You will work closely with data analysts, data scientists, and other team members to...

  • Publicis Sapient

    1 month ago


    Bangalore, Karnataka, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...


  • Bangalore, Karnataka, India TekPillar Full time

    Job Title : Senior Data Engineer (Big Data)Experience : 4-9 YearsLocation : BangaloreJob Overview : We are seeking a skilled Senior Data Engineer to coordinate with cross-functional teams, manage and prioritize projects, and drive key data engineering initiatives. The successful candidate will have a deep understanding of big data tools and the ability to...

  • Aiprus Software

    1 month ago


    Bangalore, Karnataka, India Aiprus Software Private Limited Full time

    Company Description :Aiprus Software Private Limited is an onshore-offshore based IT outsourcing company formed in March 2021, specializing in providing professional, cost-effective offshore outsourcing services globally. The company offers a full range of IT services, including Application Development, Testing, Production Support, and Product & Solution...

  • Robosoft Technologies

    3 weeks ago


    Bangalore, Karnataka, India Robosoft Technologies Full time

    Experience :- Overall 8+ years of IT experience with 5+ years in Data related technologies, and expertise of 3+ years in data-related AWS Cloud services.- Have 3+ year of experience in ClickHouse or any other OLAP system.- Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions.- Expert in...

  • Hadoop Developer

    1 month ago


    Bangalore, Karnataka, India SAPBOT Technologies Full time

    Job Description : Opportunity for Hadoop Developer. Experience : 5 to 10 yrs Relevant. Notice Period : Immediate 15 Days. Location : Bangalore. JD : - 5+ years of data warehousing/engineering, software solutions design and development experience. - Experience in designing and architecting distributed data systems. - Code, test, and document new or modified...

  • Big Data Developer

    1 month ago


    Bangalore, Karnataka, India Ekfrazo Technologies Private Limited Full time

    We are hirinig for L3 Big data developer. Experience : 4+ Yrs. Location : Bangalore. Notice period : 15 Days/ Immediate. Job description :- Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. - Architect HBase schemas and data models to accommodate...