Senior Data Engineering Specialist

2 days ago

Kannur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title: Data Engineering Expert

We are seeking a highly skilled Data Engineering Expert to join our team. This is an exceptional opportunity for a seasoned professional to design, implement and optimize data pipelines, ensuring seamless integration with cloud platforms.

The ideal candidate will have substantial experience in cloud technologies, strong command of Python, data engineering principles and a proven track record of successful implementation of scalable solutions in cloud environments.

About the Role
  • Design, Develop and Maintain Scalable Data Pipelines: Utilize Python and cloud-based technologies to design, develop and maintain efficient data pipelines that ensure seamless data transfer from diverse sources to our cloud-based data warehouse.
  • ETL Process Implementation: Implement Extract, Transform, Load (ETL) processes to move data from diverse sources into our cloud-based data warehouse.
  • Cloud Platform Deployment: Utilize cloud platforms such as Google Cloud, AWS or Azure to deploy, manage and optimize data engineering solutions.
  • Data Storage and Analysis: Leverage cloud-native services for storage, processing and analysis of large datasets.
  • Collaboration and Communication: Collaborate with data scientists, analysts and other stakeholders to design effective data models that align with business requirements.
  • Infrastructure Optimization: Ensure the scalability, reliability and performance of the overall data infrastructure on cloud platforms.
  • Issue Resolution: Continuously monitor and troubleshoot issues, ensuring timely resolution and minimal impact on data availability.
  • Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and completeness of data in the cloud-based data warehouse.
Requirements
  • Programming Languages: Proficiency in Python for data engineering tasks, scripting and automation.
  • Data Engineering Technologies: Extensive experience with data engineering frameworks like distributed data processing.
  • Cloud Platforms: In-depth knowledge and hands-on experience with at least one major cloud platform: AWS, Azure or Google Cloud.
  • ETL Processes: Proven expertise in designing and implementing Extract, Transform, Load (ETL) processes.
  • SQL and Databases: Proficient in SQL with experience in working with relational databases and cloud-based database services.
  • Data Modeling: Strong understanding of data modeling principles and experience in designing effective data models.
  • Version Control: Familiarity with version control systems for tracking changes in code and configurations.
  • Containerization and Orchestration: Familiarity with containerization technologies and orchestration tools.
  • Monitoring and Troubleshooting: Ability to implement monitoring solutions and troubleshoot issues in data pipelines.
  • Data Quality Assurance: Experience in implementing data quality checks and validation processes.
Soft Skills
  • Problem-Solving and Critical Thinking: Strong problem-solving and critical-thinking abilities.
  • Communication: Excellent communication skills, both written and verbal.
  • Collaboration: Ability to work collaboratively in a cross-functional team environment.
  • Attention to Detail: Attention to detail and commitment to delivering high-quality solutions.

This is an exceptional opportunity for a seasoned professional to join our team and contribute to the success of our organization.

  • Senior Data Quality Specialist

    2 days ago

    Kannur, Kerala, India beBeeDataQuality Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Quality SpecialistWe're seeking an experienced Senior Data Quality Specialist to lead our data testing efforts. This role offers the chance to work on high-profile projects, collaborate with talented colleagues, and contribute to the success of our organization.Key Responsibilities:Lead a team of test engineers in conducting thorough...

  • Data Engineering Specialist

    2 days ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled and experienced data engineer to join our team.About the RoleThe ideal candidate will have a strong background in data engineering, with experience working on large-scale data pipelines and a proven track record of delivering high-quality solutions.The role will involve designing,...

  • Unlock Career Advancement as a Senior Data Engineer

    24 hours ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Career Advancement as a Senior Data EngineerJob Title: Senior Data Engineer (Lead)We are seeking an experienced Senior Data Engineer to spearhead our data engineering initiatives. With 6+ years of experience in data engineering or cloud computing data development, you will conceptualize, develop, and optimize ETL/ELT data pipelines using Apache Spark,...

  • Senior Data Development Specialist

    4 days ago

    Kannur, Kerala, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Development SpecialistKey Responsibilities:We are seeking a highly skilled data development specialist to join our team. The successful candidate will be responsible for designing, implementing, and maintaining Extract, Transform, Load (ETL) processes using Relational Database Management Systems: MySQL, Oracle SQL.This role involves developing...

  • Cloud Data Engineering Specialist

    4 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data Engineering SpecialistWe are seeking a skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement scalable data processing pipelines using Azure Databricks and...

  • Senior Data Solutions Architect

    2 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job TitleWe are seeking an experienced Senior Software Engineer/Technical Specialist to join our organization. As a key member of our technology department, you will be responsible for designing and implementing scalable data architectures, developing and optimizing ETL/ELT pipelines, and ensuring data governance, security, and compliance in Azure-based data...

  • Big Data Engineer Role

    24 hours ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Data Engineer - Big Data and AnalyticsWe are seeking a highly skilled Senior Data Engineer to lead the development of big data and analytics environments on Databricks.Main Responsibilities:Design, build, and maintain complex technical architectures on Databricks, ensuring scalability, reliability, and performance.Develop and implement efficient data...

  • Data Insights Specialist

    24 hours ago

    Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Insights SpecialistOur organization is seeking a highly skilled Data Scientist to contribute to an exciting initiative building cutting-edge datasets for Large Language Model (LLM) training.The ideal candidate will have a strong background in data visualization, engineering, and Python programming, with expertise in designing and developing...

  • Senior Data Integration Engineer

    2 days ago

    Kannur, Kerala, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:We are seeking a highly skilled Data Integration Specialist to join our team.This key role involves designing, developing, and implementing data integration solutions using Informatica Powercenter and related technologies.The ideal candidate will have hands-on experience with Informatica products, including Powercenter, and a strong...

  • Generative AI Python Senior Specialist

    2 weeks ago

    Kannur, Kerala, India Coforge Full time

    Job Title: Generative AI Python Senior SpecialistLocation: Greater NoidaExperience: 7+ YearsJob Summary:Coforge is seeking a skilled Generative AI Python Senior Specialist to design and implement AI/ML and GenAI solutions. The ideal candidate will have strong programming and statistical skills, with hands-on experience in building and deploying LLM-based...