Senior Data Engineer

3 weeks ago


Bangalore, Karnataka, India Gethyr Full time

Responsibilities :


- Design and implement fine-tuned production-ready data/ml pipelines in the hadoop platform.

- Drive optimization, testing, and tools to improve quality.

- Review and approve high-level & detailed designs to ensure alignment with business needs and data & analytics architecture principles.

- Understand business requirements and develop solutions adhering to big data architectural guidelines. follow proper sdlc (code review, sprint process).

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc,build robust and scalable data infrastructure (both batch processing and real-time) to support internal and external users' needs.

- Apply and adhere to data security standards and controls for user access in the hadoop platform, support and contribute to developing guidelines and standards for data ingestion.

- Collaborate with data scientists and business analytics teams to assist in data ingestion and data-related technical issues.

- Design and document the development & deployment flow.

Requirements : Spark : 3 to 4 years.

Scala :


- Minimum 2 years of experience.

- Hadoop, hive, hbase: minimum 2 years of experience.

- Expertise in either kafka or elasticsearch.

- Professional-level english communication skills.

- Experience with scripting and linux commands.

- Experience in developing rest api services using one of the scala frameworks.

- Ability to troubleshoot and optimize complex queries on the spark platform.

- Expertise in optimizing 'big data' data/ml pipelines, architectures, and data sets.

- Experience in big data access and storage techniques.

- Experience in cost estimation based on design and development.

- Excellent debugging skills for the technical stack mentioned above.

- Highly organized, self-motivated, proactive, and able to propose the best design solutions.

- Good time management and multitasking skills to meet deadlines by working independently and as part of a team.

- Ability to analyze and understand complex problems and explain technical information in business terms.

- Strong in user requirements gathering, maintenance, and support.

- Excellent understanding of agile methodology.

- Good experience in data architecture, data modeling, and data security.

(ref:hirist.tech)
  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Senior Engineer

    3 weeks ago


    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    Immediately hiring for our client for the role of Senior Engineer Data & Analytics. Total Exp : 8+ years. Location: Anywhere in India. What you'll do:As the senior manager of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment.- Data...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Job Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...


  • Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • Senior Director

    1 week ago


    Bangalore, Karnataka, India Recruise India Consulting Full time

    Role : Senior Director - Data Engineering & AnalyticsResponsibilities :- Provide strategic leadership and vision for the data engineering and analytics function, aligning it with the overall business goals.- Lead and manage a diverse team of data engineers, data architects, data scientists, and cloud operations specialists.- Foster a culture of innovation,...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Infimetrics Info Solutions Full time

    Position : Senior Java (Data Engineer). Reports to : Technical Lead. Responsible for : Contributing to software development as per business requirements.Purpose of Role :- We are a data driven asset management firm with a very wide variety of datasets with varying frequency of updates that essentially drive our research models which ultimately determine the...

  • Senior Data Engineer

    2 hours ago


    Bangalore, Karnataka, India Scaling Theory Full time

    As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists, and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will proactively help to...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Trueblue HR Consultants Full time

    Job Description : About the job : - A technology start up based in Bangalore, India and Norwalk, CT, USA.- Founded by a diverse group of industry and healthcare leaders focussed on value optimization.- Our founders include Enterprise AI pioneers, Finance and Operations experts, Project and Change Management experts and Physicians.- The team has Research,...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Hyderabad, Karnataka, India Sam manpower services & Career LLP Full time

    As a Senior Data Engineer, you will play a critical role in our organization by leading the design, development, and maintenance of our data pipeline infrastructure. You will work closely with cross-functional teams to ensure seamless data integration and accessibility for analytical and operational purposes.Key responsibilities:- Design, construct, and...

  • Aptus Data Labs

    3 weeks ago


    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India D Square Consulting Services Pvt Ltd Full time

    Job Description : Role : Senior Data Engineer (DOMO)Experience : 5+ YearsLocation : BangaloreCandidate who can join within 30 days, may only applyWorking Mode : Work From OfficeJob Highlights :Must-Have skills :- 5+ years' experience in ELT systems (Snowflake and DOMO)- Must have experience in digital marketing projects.- Strong knowledge in digital...

  • ACL Digital

    3 weeks ago


    Bangalore/Hyderabad, Karnataka, India ACL Digital Full time

    Job Description :- We are seeking a highly skilled Senior Data Engineer with 3-12 years of experience to join our dynamic team.- As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure to support our analytics and business intelligence initiatives.- You will leverage your expertise in data...


  • Bangalore, Karnataka, India Ethos HR Management & Projects Pvt. Ltd Full time

    Job Description (Minimum 100 Characters) Your Responsibility :- Lead efforts in building and delivering the data strategy for data engineering. - Manage development and support of data fabric platform that caters to needs of real time events and batch data processing. - Manage end to end development of data products that include traditional RDBMS and big...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Consulting Pandits Full time

    Roles and Responsibilities :- Owning the design, operations and improvements for the Customer Data Warehouse infrastructure- Engineering solutions to aggregate and automate large scale data flows from varying sources- Collaborate with others to construct complex data sources for algorithms and machine learning models- Gather business requirements from...


  • Bangalore, Karnataka, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...

  • Senior Director

    3 weeks ago


    Bangalore, Karnataka, India Recrud Full time

    Job Description : Recrud is excited to partner with a leading organization in the biopharmaceutical domain to find an exceptional candidate for the role of Senior Director - Data Engineering & Analytics, focusing on commercial technology. This opportunity is based in Bengaluru and offers the chance to be at the forefront of driving technological innovation...


  • Bangalore, Karnataka, India RapidBraiins Full time

    Senior Palantir Foundry EngineerPosition Overview : We are seeking a highly skilled and experienced Senior Palantir Foundry Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing, developing, and maintaining data models, integrations, and workflows within the Palantir Foundry platform. As a Senior Palantir Foundry...