Cloud Data Processing Specialist

1 week ago

Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

About our company

We are a software-enabled services provider, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with global technology leaders.

We are seeking an experienced Data Engineer with a strong background in cloud platforms. The ideal candidate will have extensive experience with cloud-native data processing tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

**Key Responsibilities:**

  • Design, develop, and maintain scalable data pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms.
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery, and Azure Synapse.
  • Implement data processing jobs using Spark Scala.

Data Integration and Management:

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.

Performance Optimization:

  • Monitor and optimize the performance of data pipelines and data processing jobs.
  • Implement best practices for data management, including data governance, security, and compliance.

Collaboration and Communication:

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.

Documentation and Maintenance:

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing data pipelines and data integrations.

**Requirements:**

We are looking for a candidate with:

  • A Bachelor's degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms: AWS, Azure, and GCP.
  • Hands-on experience with cloud-native data processing tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other data processing tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.

**Benefits:**

  • Remote work opportunities.
  • Flexible working hours.
  • Professional development opportunities.
  • State-of-the-art technology.

**Equal Opportunity Employer:**

We are an equal opportunity employer and welcome applications from diverse candidates.

],

  • Cloud Data Infrastructure Specialist

    1 week ago

    Erode, Tamil Nadu, India beBeeDataInfrastructure Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Infrastructure SpecialistWe are seeking a highly skilled professional to join our team as a Cloud Data Infrastructure Specialist.The ideal candidate will have a strong background in data engineering, cloud computing, and infrastructure design.Key Responsibilities:Design, implement, and manage scalable data infrastructure on cloud...

  • Data Processing Specialist

    1 week ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    Job DescriptionWe are seeking a skilled Data ETL Specialist to work with our client in Pune location.The ideal candidate will be responsible for designing, deploying, and managing data integration processes using ETL tools to ensure seamless data flow from various sources. The primary goal is to optimize data processing efficiency while maintaining high data...

  • Cloud Data Integration Specialist

    2 weeks ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Cloud Data Integration SpecialistWe are seeking a seasoned data integration specialist to join our team. The ideal candidate will have extensive experience in designing, developing, testing, and deploying data integration workflows using Informatica Power Center and IICS.The successful candidate will possess advanced proficiency in Oracle SQL,...

  • Cloud Infrastructure Specialist

    6 days ago

    Erode, Tamil Nadu, India beBeeInfrastructure Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

    Job Title: Cloud Infrastructure SpecialistDescription:We are seeking a skilled Cloud Infrastructure Specialist to join our team. This role involves designing and implementing cloud-based infrastructure, orchestrating workflows, processing data, and integrating with various APIs.Key Responsibilities:Design and implement cloud-based infrastructure using Google...

  • Cloud Database Specialist

    4 days ago

    Erode, Tamil Nadu, India beBeeDatabase Full time ₹ 6,00,000 - ₹ 12,00,000

    Cloud Database Specialist JobThis position involves managing and monitoring databases hosted on cloud platforms, ensuring seamless performance and availability.Key Responsibilities:Assist in provisioning, configuring, and maintaining cloud-hosted databases, including Amazon RDS, Azure SQL Database, and Cloud SQL.Monitor database performance using...

  • Cloud Infrastructure Architect

    1 week ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistWe seek a highly skilled GCP Data Engineer to design, implement and maintain large-scale data processing systems on Google Cloud Platform.Required Skills:Proficiency in SQL Database writing queriesExpertise in GCP, specifically BigQuery for real-time analyticsExperience with data ingestion using Cloud Pub/SubFamiliarity with...

  • Cloud Data Engineering Specialist

    1 week ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineer RoleWe are seeking a seasoned data engineer to design and implement scalable cloud-based solutions using GCP services.Data Engineering Expertise: Develop efficient data pipelines utilizing BigQuery, Dataflow, and Cloud Composer.Big Data Analytics Solutions: Implement robust analytics solutions leveraging Hadoop, Hive, Spark, and Python on...

  • Senior Cloud Data Architect

    4 days ago

    Erode, Tamil Nadu, India beBeeCloudEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Senior Software Engineer/Technical SpecialistThe position is for an experienced professional who will design, implement and optimize data solutions in a cloud-based environment.This role requires someone with strong technical skills and ability to work independently. The successful candidate will be able to communicate effectively with...

  • Cloud Security Specialist

    1 week ago

    Erode, Tamil Nadu, India beBeeSecurity Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a Cloud Security Specialist to design and implement robust security protocols for our private cloud infrastructure.The ideal candidate will have a deep understanding of Network, Firewall, Database, Perimeter Security, Endpoint Security, and be able to manage infrastructure security across clusters, applications, and networking...

  • Oracle Integration Cloud Specialist

    7 days ago

    Erode, Tamil Nadu, India beBeeIntegration Full time ₹ 9,00,000 - ₹ 14,50,000

    Job Title: Oracle Integration Cloud SpecialistWe are seeking a highly skilled and experienced Oracle Integration Cloud (OIC) specialist to join our team.The ideal candidate will have strong technical skills in designing, developing, and implementing integration solutions using OIC, as well as experience working with related technologies such as REST, SOAP...