Data Engineer

4 weeks ago

Palakkad, India GEMRAJ TECHNOLOGIES LIMITED Full time

Job Title: Data Engineer Location: RemotePosition: Full-timeExp- Must Have 8+ YearsPosition OverviewWe are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data engineering, and is excited about blending these disciplines to create innovative solutions.You will be responsible for one or more software and data products, participating in architectural decisions, design, development, and evaluation of new technical solutions. This role also involves leading a small team of developers.Key ResponsibilitiesManage and optimize data and compute environments to enable efficient use of data assetsDesign, build, test, and deploy scalable and reusable systems capable of handling large volumes of dataLead a small team of developers; conduct code reviews and mentor junior engineersContinuously learn and help teach emerging technologies to the teamCollaborate with cross-functional teams to integrate data into broader applicationsRequired SkillsProven experience designing and managing data flowsExpertise in designing systems and APIs for data integration8+ years of hands-on experience with Linux, Bash, Python, and SQL4+ years working with Spark and other components in the Hadoop ecosystem4+ years of experience using AWS cloud services, particularly:EMRGlueAthenaRedshift4+ years of experience managing a development teamDeep passion for technology and enthusiasm for solving complex, real-world problems using cutting-edge toolsAdditional Skills (Preferred)BS, MS, or PhD in Computer Science, Engineering, or equivalent practical experienceStrong experience with Python, C++, or other widely-used languagesExperience working with petabyte-scale data infrastructureSolid understanding of:Data organization: partitioning, clustering, file sizes, file formatsData cataloging: Hive/Hive Metastore, AWS Glue, or similarBackground working with relational databasesProficiency with Hadoop, Hive, Spark, or similar toolsExposure to modern data stack technologies like dbt, airbyteExperience building scalable data pipelines (e.g., Airflow is a plus)Strong background with AWS and/or Google Cloud Platform (GCP)Demonstrated ability to independently lead projects from concept through launch and ongoing support

  • Cloud Data Engineer

    1 day ago

    palakkad, India beBeeDataEngineer Full time

    About the RoleWe are seeking an experienced data engineer to design, develop, and maintain cloud-based data pipelines and analytics solutions using AWS services.The ideal candidate should have strong skills in Python and SQL, with advanced knowledge of data engineering principles and practices.The selected candidate will work closely with our team to:Design...

  • Azure data engineer

    6 days ago

    Palakkad, India SystemBender Full time

    *Role: Azure Data Engineer* • Advance SQL Azure Data Factory (ADF) Databricks with Py Spark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (Py Spark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...

  • Data Engineer

    4 weeks ago

    Palakkad, India Taiyō.AI Full time

    About UsTaiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universaland industry standard database of opportunities (tenders, projects, news) and threats (economy,climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has been instrumental in shapinghow infrastructure companies (infra investors,...

  • Technical Project Manager-Data Engineering

    3 weeks ago

    Palakkad, India Reflections Info Systems Full time

    We are looking for 13+years experienced candidates for this role.Mode: HybridPreferred Location: Cochin/Trivandrum/ChennaiPrimary Skills :- Overall 13+ Years of Experience in IT with 6+ years of experience as a Technical Product Manager, Technical Program Manager, or Delivery Lead. - Hands-on development experience in data engineering, including data...

  • Azure Data Services Engineer – Microsoft Fabric

    2 weeks ago

    Palakkad, India Gravity Infosolutions, Inc. Full time

    Position: Azure Data Engineer – Microsoft FabricExperience: 6+ yearsLocation: RemoteJob Summary:We are looking for an experienced Azure Data Engineer with strong expertise in Microsoft Fabric and the Azure data ecosystem. The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and business insights across...

  • Data Systems Architect

    3 days ago

    palakkad, India beBeeAutomation Full time

    Data Engineering OpportunityJob Description:The role of a data engineer is to design, build, and maintain the infrastructure that stores and processes large-scale data. This includes creating data pipelines, integrating various data systems, and ensuring data quality and integrity.Required Skills and Qualifications:Deep hands-on experience with Unity...

  • Chief Data Architect

    1 day ago

    palakkad, India beBeeDataEngineer Full time

    Data Engineer Job DescriptionWe are seeking an experienced Data Engineer to join our development team.Role: Sr. Azure Data EngineerLocation: Pune/Bangalore Experience: 5 to 8 yearsJob Type: Full Time EmploymentThe ideal candidate will design and implement scalable data pipelines for ingestion, processing, and transformation using Azure Databricks...

  • Opening for Senior GCP Data Engineer @ Remote

    7 days ago

    Palakkad, India Quess IT Staffing Full time

    Hi,Exp: 8+ YearsEssential Skills:6+ years of professional experience in data engineering or a similar role.Hands-on experience with Google Cloud Platform (GCP) services (BigQuery, Cloud Run, Scheduler).Proficiency in SQL for data manipulation and analysis.Experience with dbt.Familiarity with infrastructure-as-code principles.Strong programming skills in...

  • Enterprise Data Architect

    4 weeks ago

    Palakkad, India DBiz.ai Full time

    The Enterprise Data Architect/Data Modeler is a senior technical leader responsible for defining, designing and governing the organization’s enterprise data architecture. You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI/ML initiatives at scale. You will work closely with business...

  • Enterprise Data Architect

    4 weeks ago

    Palakkad, India DBiz.ai Full time

    The Enterprise Data Architect/Data Modeler is a senior technical leader responsible for defining, designing and governing the organization’s enterprise data architecture. You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI/ML initiatives at scale. You will work closely with business...