Data Platform Engineer

3 weeks ago


India BrightEdge Full time

Responsibilities:

  • Design, develop, and maintain the data platform architecture to support large-scale data processing and analytics.
  • Implement and optimize data pipelines and ETL processes using Apache Doris and Python for efficient data processing and analysis.
  • Collaborate with cross-functional teams to integrate and interface various data sources and data processing tools within the platform.
  • Provide technical leadership in the design and implementation of scalable data solutions in a cloud environment, particularly utilizing AWS services.
  • Drive the adoption of best practices for data management, processing, and analytics within the organization.
  • Troubleshoot performance issues, optimize query execution, and ensure data integrity and security.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, or related technical field.
  • 9+ years of extensive experience in designing and building data platforms and large-scale data processing systems.
  • Strong proficiency in Apache Doris for real-time analytics, complex querying, and data processing.
  • Expertise in Python programming for building data pipelines and analytics solutions.
  • Hands-on experience with cloud platforms, particularly AWS, for building scalable and efficient data solutions.
  • In-depth knowledge of ETL processes, data warehousing concepts, and data modeling.
  • Excellent problem-solving skills and the ability to collaborate effectively with cross-functional teams.

  • Operations Specialist

    1 month ago


    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Operations Specialist

    1 month ago


    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • india Zyoin group Full time

    We're seeking a talented and experienced Data Platform Engineer to join our team and play a key role in optimizing, maintaining, and evolving our data infrastructure. You'll be responsible for ensuring our data pipelines run smoothly, efficiently, and cost-effectively, while contributing to a stable and exceptional user Pipeline Powerhouse: Streamline and...


  • India BrightEdge Full time

    Responsibilities:Design, develop, and maintain the data platform architecture to support large-scale data processing and analytics.Implement and optimize data pipelines and ETL processes using Apache Doris and Python for efficient data processing and analysis.Collaborate with cross-functional teams to integrate and interface various data sources and data...


  • india BrightEdge Full time

    Responsibilities: Design, develop, and maintain the data platform architecture to support large-scale data processing and analytics. Implement and optimize data pipelines and ETL processes using Apache Doris and Python for efficient data processing and analysis. Collaborate with cross-functional teams to integrate and interface various data sources and data...


  • India BrightEdge Full time

    Responsibilities:Designing, developing, and maintaining the data platform architecture to support large-scale data processing and analytics.Implementing and optimizing data pipelines and ETL processes using Apache Doris and Python for efficient data processing and analysis.Collaborating with cross-functional teams to integrate and interface various data...


  • India BrightEdge Full time

    Responsibilities:Design, develop, and maintain the data platform architecture to support large-scale data processing and analytics.Implement and optimize data pipelines and ETL processes using Apache Doris and Python for efficient data processing and analysis.Collaborate with cross-functional teams to integrate and interface various data sources and data...

  • Aptus Data Labs

    1 month ago


    india Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...


  • india Consultz Full time

    Job Description This role is for DataHonDo, based in Singapore. Consultz is supporting the hiring for DataHonDo.Azure Data Platform Design and Implementation: Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure,...


  • india Consultz Full time

    Job Description This role is for DataHonDo, based in Singapore. Consultz is supporting the hiring for DataHonDo.Azure Data Platform Design and Implementation: Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure,...


  • India Consultz Full time

    Job Description This role is for DataHonDo, based in Singapore. Consultz is supporting the hiring for DataHonDo.Azure Data Platform Design and Implementation: Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure,...

  • Data Engineer

    2 months ago


    india KARYA CONSULTANTS PRIVATE LIMITED Full time

    As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services.Key Responsibilities :Data Architecture : - Design and implement scalable and efficient data...


  • Anywhere in India/Multiple Locations, IN Zyoin group Full time

    We're seeking a talented and experienced Data Platform Engineer to join our team and play a key role in optimizing, maintaining, and evolving our data infrastructure. You'll be responsible for ensuring our data pipelines run smoothly, efficiently, and cost-effectively, while contributing to a stable and exceptional user Pipeline Powerhouse:...

  • Engineering Manager

    3 weeks ago


    india Coinbase Full time

    At Coinbase, our mission is to, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who always lead the group project? That’s...

  • Engineering Manager

    1 month ago


    india Coinbase Full time

    At Coinbase, our mission is to, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who always lead the group project? That’s...


  • india Sourceone Staffing & Consulting Pvt Ltd Full time

    Data Platform Support EngineerLocation : SingaporeTeam/ Competency : Production SupportCore Skillsets : Service Delivery, Batch scheduling and monitoring, ETL Development, SQLHigh Level Job Scope : Production SupportJob Description : Big Data Support EngineerSkillset :- Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems- Last 3 years of...

  • Aptus Data Labs

    3 weeks ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...