Data Engineer

6 days ago

Chennai, Tamil Nadu, India Altimetrik Full time
Job Title: Data Engineer - Cloud Expert

We are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP), particularly in BigQuery and Pub/Sub, coupled with advanced proficiency in Python. As a Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data pipelines, ensuring the smooth flow of data within our organization.

Responsibilities:
  • Architect and Develop Data Pipelines: Design, develop, and maintain scalable and efficient data pipelines using GCP services such as Pub/Sub for real-time data ingestion and BigQuery for storage and analysis.
  • Data Transformation and Processing: Implement data transformation processes to cleanse, enrich, and aggregate raw data from various sources, ensuring data quality and consistency.
  • Optimize Performance: Fine-tune data pipelines and queries to optimize performance and reduce latency, ensuring timely access to data for stakeholders.
  • Monitoring and Maintenance: Implement monitoring solutions to track pipeline performance and proactively address issues. Perform regular maintenance tasks to ensure the reliability and availability of data infrastructure.
  • Collaboration: Collaborate with cross-functional teams including Data Scientists, Software Engineers, and Business Analysts to understand data requirements and provide technical solutions to address business needs.
  • Documentation: Document data pipelines, processes, and best practices to ensure knowledge sharing and maintain a comprehensive understanding of data architecture.
Requirements:
  • Proficiency in GCP Services: Extensive hands-on experience with Google Cloud Platform services, particularly BigQuery for data storage and analysis, and Pub/Sub for real-time data streaming.
  • Python Programming: Strong programming skills in Python for data manipulation, scripting, and automation tasks. Experience with libraries such as Pandas, NumPy, and TensorFlow is highly desirable.
  • Data Modeling: Solid understanding of data modeling concepts and experience in designing efficient data models for analytics and reporting purposes.
  • SQL Skills: Proficiency in writing complex SQL queries for data extraction, transformation, and analysis within BigQuery.
  • Experience with Data Warehousing: Familiarity with data warehousing concepts and experience in implementing data warehouse solutions using GCP BigQuery or similar technologies.
  • Problem-solving Skills: Strong analytical and problem-solving skills with the ability to troubleshoot and resolve complex data-related issues.
  • Communication Skills: Excellent communication skills with the ability to effectively collaborate with cross-functional teams and articulate technical concepts to non-technical stakeholders.
  • Bachelor's Degree: Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field. Advanced degree or relevant certifications in Data Engineering or GCP are a plus.

  • Data Engineering Leader

    4 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...

  • Data Engineering Leader

    6 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a seasoned data engineering leader to drive the technical strategy and oversee complex data projects.Key Responsibilities:Lead and manage the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Data Engineering Director

    6 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary leader to drive the technical strategy and manage our growing Data Engineering team.Key Responsibilities:Lead and mentor the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Associate Specialist

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly motivated and detail-oriented Associate Critical Facilities Operations and Maintenance Engineer to join our team. As a key member of our Critical Facilities Operations and Maintenance team, you will be responsible for designing, planning, installing, and maintaining mechanical, electrical, and other infrastructure...

  • Engineering Director

    6 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Engineering ManagerCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking an experienced Engineering Manager to lead our technical teams and drive the development of our flagship platform, maya.ai.Key Responsibilities:Lead complex initiatives with...

  • Security Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Security Managed Services Engineer to join our team at NTT DATA. As a key member of our security team, you will be responsible for providing proactive technical support to our clients, ensuring the security and integrity of their infrastructure.Key ResponsibilitiesProactively identify and resolve technical...

  • Senior Software Engineering Lead

    21 hours ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineering LeadCrayon Data, a leading provider of AI-led revenue acceleration solutions, is seeking a seasoned Senior Software Engineering Lead to drive the development of our flagship platform, maya.ai. As a key member of our engineering team, you will be responsible for leading the design and implementation of scalable, flexible, and...

  • Senior Engineering Leader

    4 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Senior Engineering LeaderCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking a Senior Engineering Leader to join our team and drive the development of our flagship platform, maya.ai.About the RoleWe are looking for a highly skilled and experienced...

  • Senior Engineering Leader

    21 hours ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Job Title: Senior Engineering LeaderAbout the Role:We are seeking a highly skilled Senior Engineering Leader to join our team at Crayon Data. As a key member of our engineering team, you will be responsible for leading complex initiatives with long-term, strategic value.Key Responsibilities:Lead complex initiatives with long-term, strategic valueOwned...

  • Engineering Manager

    6 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE.Our flagship platform, maya.ai, helps enterprises across the Banking, Fintech, and Travel industries create and capture sustainable revenue streams by unlocking the value of data.Job DescriptionWe...

  • Senior Engineering Leader

    4 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Senior Engineering LeaderCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We're seeking a seasoned Senior Engineering Leader to drive the growth of our engineering team.Key Responsibilities:Lead complex initiatives with long-term, strategic valueOwned capacity...

  • Security Managed Services Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Security Managed Services EngineerAbout the Role:We are seeking a highly skilled Security Managed Services Engineer to join our team at NTT DATA. As a Security Managed Services Engineer, you will be responsible for providing a managed service to clients to ensure that their Firewall infrastructure remains operational.Key Responsibilities:Monitor...

  • Machine Learning Engineer

    2 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    About the Role:Crayon Data, a leading provider of AI-led revenue acceleration solutions, is seeking a highly skilled Machine Learning Engineer to join our team. As an MLops Engineer, you will play a crucial role in driving the development and deployment of our flagship platform, maya.ai.Key Responsibilities:Design and implement end-to-end machine learning...

  • Senior Data Centre Construction Project Manager

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleThe Senior Manager of Data Centre Construction Project Management is a senior leadership position at NTT DATA, responsible for planning, executing, and managing data centre construction projects. This role involves leading project teams, collaborating with cross-functional groups, managing resources, and ensuring projects are completed on...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Encora Inc. Full time

    Job Title: Data EngineerJob Summary:Encora Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems to support business growth and decision-making.Key Responsibilities:• Develop and implement data pipelines to extract, transform, and load...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India sarvajith infotech Full time

    Senior Data EngineerWe are seeking a highly skilled and detail-oriented Senior Data Engineer to join our team at Sarvajith Infotech. The ideal candidate will have a strong background in data engineering with expertise in Python, Databricks, and Snowflake.Key Responsibilities:Work with architects and leads to design and implement data solutions that meet...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Pearson Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Pearson. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure to support business decision-making.Key Responsibilities:Design and implement data pipelines using GCP services such as BigQuery, Cloud SQL, and...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Comcast Corporation Full time

    Job Title: Data EngineerComcast Corporation is seeking a highly skilled Data Engineer to join our Unified Communications Engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures to support our business needs.Key Responsibilities:Design and implement data pipelines...

  • Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India Getinz Techno Services Full time

    Job Title: Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Getinz Techno Services in Chennai. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using AWS Glue and Pyspark for ETL...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India FedEx Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at FedEx. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines to support our business operations.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from...