Big Data Engineer/Lead

4 weeks ago


Bangalore, India TekPillar Full time

Job Title: Big Data Engineer/Lead


About the Role:


We are seeking a highly skilled Big Data Engineer/Lead to join our dynamic team in Bangalore. As a key member of our data engineering initiatives, you will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.


Key Responsibilities:


• Collaborate with stakeholders to understand their data needs and deliver effective solutions.


• Define and manage data load procedures, ensuring adherence to quality thresholds and business rules.


• Implement and maintain CI/CD pipelines for data solutions, facilitating rapid and reliable updates.


• Analyze business requirements and translate them into data models.


• Design and create robust, scalable data pipelines and data products across various domains.


• Develop and maintain data lakes by integrating data from primary and secondary sources.


• Coordinate with cross-functional teams to manage project priorities and execution.


• Lead data strategy implementation, collaborating with development, data analyst, and information system teams.


• Mentor and guide junior data engineers, ensuring best practices in data engineering principles.


Technical Requirements:


• Proficient in Big Data Tools: Hadoop, Hive, Spark


• Expertise in Programming Languages: Scala, Python, SQL, PySpark


• Experience with Database Management: PostgreSQL, Cassandra


• Familiarity with Cloud Services: AWS, Azure


• Experience with Data Pipeline Tools: Airflow, Kafka, Spark-Streaming


  • Big Data Engineer

    1 month ago


    Bangalore, India Rigel networks Full time

    Job Title: Big Data EngineerJob Description:At Rigel Networks, we are seeking a highly skilled Big Data Engineer to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing big data systems using PySpark, database migration, transformation, and integration solutions for data warehousing projects.Key...

  • Big Data Engineer

    1 month ago


    Bangalore, India Draup Full time

    Job Title: Big Data EngineerAbout the Role:The Big Data Engineer at Draup is responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis. This role involves building generic and reusable data platforms and pipelines. You will work with a team of experienced developers, engineers, and product...

  • Big Data Engineer

    1 month ago


    Bangalore, India TekPillar Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer to join our team at TekPillar. The ideal candidate will have a strong background in big data tools, programming languages, and cloud experience.Key ResponsibilitiesDesign and implement large-scale data engineering initiativesLead a team of engineers in the development and deployment of data...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, India Robosoft Technologies Full time

    As a seasoned Big Data Lead, you will play a pivotal role in driving our company's data-driven initiatives forward. With a strong background in IT and extensive experience in data-related technologies, you will be responsible for architecting and implementing end-to-end big data solutions that drive business growth and innovation.Key ResponsibilitiesDesign...

  • Big Data Engineer

    1 month ago


    Bangalore, India Talpro Full time

    Job Title: Big Data EngineerAt Talpro, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using Python, PySpark, and...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Draup Full time

    Role : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for designing, implementing, and maintaining scalable techniques and processes for data storage, transformations, and analysis. This role involves working with a proficient team of developers, engineers, and product team to shape up the data products. The ideal candidate...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Madhees Techno Consulting Pvt. Ltd Full time

    Job Title: Senior Data Engineer at Madhees Techno Consulting Pvt. LtdAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing scalable and efficient big data solutions using Spark, Scala, and other relevant...

  • Big Data Engineer

    1 month ago


    Bangalore, India MaimsD Technology Full time

    About the Role:At MaimsD Technology, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining applications that process and analyze large datasets. You will work closely with data analysts, data scientists, and other team members to...

  • Data Engineer

    4 weeks ago


    Bangalore, India Rigel networks Full time

    Job Title - Data Engineer - Big Data SystemsAt Rigel networks, we are seeking a highly skilled Data Engineer to lead the design and implementation of our Big Data systems using PySpark. The ideal candidate will have excellent knowledge in Apache Spark and Python programming experience, as well as deep experience in developing data processing tasks using...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Talpro Full time

    Job Title: Big Data EngineerJob Summary:Talpro is seeking an experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines using Python, PySpark, and Scala.Key Responsibilities:Develop and maintain scalable data pipelines using Python, PySpark, and Scala.Work...


  • Bangalore, Karnataka, India FxConsulting Full time

    Job Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities : - Design,...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Aritha Consulting Services Pvt. Ltd. Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to join our team at Aritha Consulting Services Pvt. Ltd. as a key member of our data engineering group. The successful candidate will be responsible for designing and implementing scalable data pipelines to support our growing business needs.Key Responsibilities:Design and develop...


  • Bangalore, Karnataka, India TekPillar Full time

    Join our dynamic team in Bangalore as a Big Data Engineer contribute to our key data engineering initiatives! You will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.Job Title : Big Data Engineer/ LeadExperience : 4 to 9 YearsLocation : BangaloreKey Responsibilities : - Collaborate...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2This role involves translating client requirements into technical design and implementing data engineering solutions. You will utilize deep understanding of data integration and big data design principles to create custom solutions or implement package solutions. Your key responsibilities will include data ingestion,...

  • Big Data Engineer

    4 weeks ago


    Gurgaon/Gurugram/Bangalore/Hyderabad, India Huquo Full time

    Huquo is seeking a Big Data Engineer to join our team.We are looking for a skilled professional with expertise in Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet) and Python programming language. Additionally, you should have experience with PySpark, SQL, and Agile Methodology.Key Responsibilities:Develop and maintain large-scale data...

  • Big data Engineer

    6 days ago


    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Data Engineer

    4 weeks ago


    Bangalore, India FALABELLA CORPORATE SERVICES INDIA PRIVATE LIMITED Full time

    About the RoleFalabella Corporate Services India Private Limited is seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies.Key ResponsibilitiesDesign and implement data...

  • Big Data Engineer

    4 weeks ago


    Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full time

    Job Title: Senior Scala Developer for Big DataLocation: Type: Full-TimeJob Overview:We are seeking a highly skilled Senior Scala Developer for Big Data to lead our team in designing, developing, and optimizing data processing pipelines using Apache Spark. The ideal candidate will have a deep understanding of big data technologies and strong programming...

  • Big Data Engineer

    1 week ago


    bangalore, India Eximietas Design Full time

    6+ yearsof experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience inJava● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of data...