Senior Data Engineer

5 days ago


Alappuzha, India NeST Digital Full time
  • Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
  • Design and develop microservices to
  • Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
  • Implement data integration and data quality processes to ensure the accuracy and reliability of data for analytics and reporting.
  • Optimize data storage, processing, and querying performance for large-scale datasets.
  • Enable advanced analytics and machine learning capabilities on the data platform.
  • Continuously monitor and improve data quality and data governance practices.
  • Stay up to date with the latest data engineering trends, technologies, and best practices.

Requirements:

  • Bachelor’s degree in computer science, Engineering, or a related field.
  • 8+ of proven experience in data engineering, data warehousing, and ETL processes.
  • Proficiency in data engineering tools and technologies such as SQL, Python, Spark, Hadoop, DBT, Airflow, Apache Kafka and Presto.
  • Solid experience with table formats such as Delta Lake or Apache Iceberg
  • Design and development experience with batch and real time streaming infrastructure and workloads.
  • Solid experience with implementing data lineage, data quality and data observability for Big data workflows.
  • Solid experience designing and developing microservices and distributed architecture.
  • Hands-on experience with GCP ecosystem and data lakehouse architectures.
  • Strong experience with implementing Databricks.
  • Strong experience with container technologies such as Docker, Kubernetes.
  • Strong understanding of data modeling, data architecture, and data governance principles.
  • Excellent experience with DataOps principles and test automation.
  • Familiarity with data processing and querying using distributed systems and NoSQL databases.
  • Ability to optimize and tune data processing and storage for performance and cost-efficiency.
  • Excellent problem-solving skills and the ability to work on complex data engineering challenges.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.
  • Previous experience mentoring and guiding junior data engineers is a plus.
  • Relevant certifications in data engineering or cloud technologies are desirable.

Nice to have:

  • Experience working in a Data Mesh architecture.
  • Supply Chain domain experience.


  • Data Engineer

    4 weeks ago


    Alappuzha, India Giant Eagle GCC Full time

    Data Engineer -Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...

  • Data Engineer

    3 weeks ago


    Alappuzha, India Capgemini Engineering Full time

    Job Description:Note:Working hours 3 PM-12 AM IST● Bachelor's degree in CS/IT or related field● 3+ years of experience in application support ● 3+ years experience in SQL development● 3+ years experience in data modeling, ETL, and Data Warehousing● Experience working on AWS platforms (including various services)● Experience with support platforms...


  • Alappuzha, India upGrad Full time

    We are seeking a highly skilled Senior Software Engineer to join our dynamic team in Hyderabad. The ideal candidate will have strong expertise in NestJS, Node.js, MongoDB, and TypeScript. As a Senior Software Engineer, you will be responsible for designing, developing, and implementing robust and scalable software solutions to support our online education...


  • Alappuzha, India Razorpay Full time

    Title: Senior Software Development Engineer The Role:A Senior Software Development Engineer at Razorpay is well-grounded - smart, quality focussed, product thinker, business conscious - not mere coders, of course, with very good technical context and experience to write and build quality software. Engineering creates a significant impact across different...


  • Alappuzha, India Walmart Global Tech Full time

    About TeamThe Import Synchronization Tool (IST) provides real-time visibility of Direct Import flows from the Suppliers to Consolidation Centers. It is a planning and visibility product that provides granular, daily, real-time visibility of Direct Import flows from the Supplier, Foreign Port, US Port until ​the In-land FSCs and helps synchronize the demand...


  • Alappuzha, India NOVARGI Full time

    NOVARGI Indian branch, an Indian established company belonging to the International Group NOVARGI, is currently seeking an Civil Senior Engineering Design to join our Indian team based in the Office of Gurgaon.NOVARGI Group, as a highly specialized Process Package and Plant Contractor for the Energy Sector, we contribute to better tomorrow with our process...


  • Alappuzha, India Hanuma InfoTech Full time

    Seeking an experienced AI/ML/LLM Data Engineer to collaborate with cross-functional teams in building ML infrastructure to train models. You will optimize employee experiences and drive business outcomes using cutting-edge AI/ML/LLM  technologies. Join us at the forefront of the latest advancements in the field.Responsibilities:6+ years programming...


  • Alappuzha, India IGT Solutions Full time

    Role : Senior Java DeveloperLocation: RemoteExperience :- 5 to 9 yrsMandate Skillsets: Core Java (Java 8 and above), Spring boot, spring security, spring data OOPs, Unit Testing Junit, Sonar , Security Vulnerabilities , Database, RDBMS , REST API, Container runtime ( e.g. Docker etc)Other Skillsets: Spring cloud, Blockchain, Kubernetes, AzureAbout Us: Join...


  • Alappuzha, India eInfochips (An Arrow Company) Full time

    Role: Senior Engineer – ASIC Design VerificationLocation: Across IndiaExperience: 4 to 8 YearsWORK FROM OFFICE : Bangalore | Hyderabad |Chennai |Noida | Ahmedabad |PuneABOUT eInfochips (An Arrow Company):eInfochips, an Arrow company (A $30B, NASDAQ listed (ARW); Ranked #102 on the Fortune List), is a leading global provider of product engineering and...


  • Alappuzha, India Alp Consulting Ltd. Full time

    Hello Everyone,Greetings from ALP!!!We have an opportunity for Embedded Automation QA EngineerTitle: Senior Embedded Automation QA Engineer Location : Hyderabad Exp : 5-10 Yrs5-10 years of experience in testing, test automation development, and working with test frameworks Experienced (2+ years) and proficient in Python scripting and Python packages...

  • Data Engineer

    2 days ago


    Alappuzha, India Delphic (South Asia) Full time

    Responsibilities: Lead design and architectural discussions with the client team.Design AWS Snowflake based analytics platform.Lead a team of 5-7 members. Qualifications: At least 5 years of Snowflake experience. 3-5 yrs exp with AWS data services, Glue is a must.Required Skills: Experience with Snowflake.3-5 years of experience with AWS data services,...


  • Alappuzha, India Insight Global Full time

    Insight Global is looking for a talented and experienced OCR Contextualization Engineer to join a Fortune 500 Chemical Manufacturing client in their Hyderabad, India office. As a Contextualization Engineer, you will be responsible for developing, maintaining and implementing cutting-edge OCR based AI models to contextualize data from complex enterprise...

  • Data Scientist

    3 weeks ago


    alappuzha, India InCommon Full time

    Job Type: Contract Location: India (Remote) ⏱️ Work Timings: US Timings - 4 PM to 1 AM IST ️ Experience Required: 4+ Years of relevant experience ⌛ Hiring Timeline: Immediate - 30 Days Hiring Process: Resume review - Initial screen - Technical Interviews (2) - Leadership & Behavior Interviews About the company Incommon is hiring on...

  • Lead AI ML Engineer

    1 week ago


    Alappuzha, India Programmers.io Full time

    Job Description: Job Title: Senior .Machine Learning Engineer/ Lead Shift Timings: should be available to work till 9:00-9:30 PM IST Location: Remote Experience required: 7 to 10 years We are seeking a talented and experienced Machine Learning Engineer , specializing in developing and deploying machine learning models for Natural Language Processing...


  • Alappuzha, India Byzanlink Full time

    ***** 5+ years of experience in Blockchain is a must *****As a Senior Solidity Engineer at Byzanlink, you will be responsible for smart contract development and integration. Day-to-day tasks may include building and maintaining features, testing and deploying code, debugging and optimizing the gas, performance, and collaborating with cross-functional...

  • Field Engineer

    1 month ago


    Alappuzha, India JEF GROUP Full time

    Graduate Engineering Trainee/ Field EngineerAbout JEF:JEF is an innovative company with Indian roots and an extensive international presence across 23 countriesin the ASEAN, Middle Eastern, African and European regions. We have been the preferred vendor forprestigious projects in many countries with 3000+ global customers and an astounding 90%...


  • Alappuzha, India People Tech Group Inc Full time

    Hello connections We are Hiring '' Lead /Data Architect Aws Devops Engineer '' and below are the requirements. This will be through ''People Tech Group Company''. Position: Aws Lead Devops Engineer/Data Architect Company : People Tech Group ( Mnc) Mode of Work: WFO Experience: 6+yrs Location : Bangalore Only Mandatory Skill: Aws, cloud engineer, Devops...

  • Senior Editor

    4 weeks ago


    Alappuzha, India Franchise India Holdings Limited Full time

    Multiple Job Location - FaridabadJob Title: Senior Editor (Retailers Magazine)Job Description:Be self-organized and be able to meet deadlines.Reporting to the Editor-Digital or Editor-Print, it will be your mission to write agenda-setting journalism and make yourself one of the best-known figures in the world of startups.Possess the ability to collect and...

  • Data Architect

    1 month ago


    Alappuzha, India Lingaro Full time

    Requirements:Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.Proven experience as a Data Architect or in a similar role, ideally in a complex organizational setting.Strong understanding of data management principles, data modeling techniques, database design and data integration flows.Experience in developing and...

  • Product Engineer

    2 weeks ago


    alappuzha, India ACA Group Full time

    About ACA: ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We empower our clients to reimagine GRC and protect and grow their business. Our innovative approach integrates consulting, managed services, and our ComplianceAlpha® technology platform with the specialized expertise of former regulators and...