Data Engineering Specialist

1 week ago

Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,22,535 - ₹ 20,33,548

Job Title: Data Engineering Specialist

We are seeking a highly skilled and experienced data engineer to join our team. The ideal candidate should have a strong background in AWS services, including Glue, EMR, Lambda, and expertise in data modelling, Python, SQL, PartiQL and integrating third-party APIs from scratch.

  • Design, develop, and implement end-to-end data engineering solutions from ground up on the AWS platform using services such as Glue, EMR, Lambda, and more.
  • Design and implement scalable DynamoDB databases, optimizing performance and ensuring data consistency, throughput, and storage efficiency.
  • Collaborate with cross-functional teams and stakeholders to gather data requirements and understand business objectives.
  • Architect and implement data models and schemas that align with best practices and optimize query performance.
  • Build robust and scalable data pipelines to extract, transform, and load (ETL) data from diverse sources into target systems.
  • Integrate third-party APIs to retrieve and ingest data from external systems, ensuring data accuracy and reliability.
  • Perform data profiling, data cleansing, and data quality checks to ensure accuracy and consistency.
  • Optimize SQL queries and database performance, leveraging SQL tuning techniques and indexing strategies.
  • Implement data governance and security measures to protect sensitive data throughout the pipeline.
  • Develop and maintain documentation for data pipelines, data flows, and data transformations.
  • Stay up-to-date with industry trends and emerging technologies in data engineering, AWS services, and third-party API integrations.
  • Mentor junior team members and provide technical guidance and support as needed.

Requirements:

  • Bachelor's degree in Computer Science or a related field.
  • Minimum of 2+ years of experience in data engineering, specifically in building and maintaining data pipelines from scratch.
  • Strong proficiency in AWS services such as Glue, EMR, Lambda, Dynamo DB, Postgres.
  • Expertise in data modelling, schema design, and relational and non-relational database concepts.
  • Solid working knowledge of SQL, SQL tuning, and data modeling best practices.

Benefits:

  • A flat hierarchy.
  • ESOPs.
  • Group Medical Coverage.
  • 30 days of Leave.
  • A gender-neutral parental, marriage, and compassionate leave policy.

Key Skills:

  • Experience in designing and implementing single-table architecture in DynamoDB, optimizing data models for scalability, efficient query patterns, and minimal read/write costs.
  • Proficiency in using PartiQL to query and manipulate data in DynamoDB, with a focus on optimizing queries for performance and integrating complex business logic.
  • Experience in developing and optimizing SQL queries for performance.
  • Proficiency in Python programming for data manipulation, transformation, and scripting tasks.
  • Familiarity with data warehouse concepts, OLAP, and Big Data technologies.
  • Experience in integrating third-party APIs to retrieve and ingest data from external systems.

Personal Attributes:

  • A team player with good interpersonal skills and problem-solving abilities.
  • A self-motivator and a collaborative team player.
  • Excellent time management skills and the ability to assume leadership roles when necessary.
  • Agile, action-oriented, and a quick learner.
  • An out-of-the-box thinker.

  • Data Engineering Specialist

    2 weeks ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Overview:About the RoleWe are seeking a skilled Data Engineering Specialist to lead our data architecture efforts and design scalable data solutions.Key Responsibilities:Develop and maintain data engineering standards, guidelines, and best practices.Collaborate with cross-functional teams to implement data warehousing, big data, and data analytics...

  • Data Engineering Specialist

    2 weeks ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    About This RoleAs a Data Engineering Specialist, you will design, develop, and maintain large-scale data systems to process and analyze massive datasets. You will work with distributed data processing and storage technologies like Apache Spark, Hadoop, and cloud platforms such as AWS/GCP/Azure.This role requires expertise in developing efficient ETL...

  • Data Engineering Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    ETL Data Specialist Job DescriptionThis role is an opportunity to work on designing, deploying, and managing ETL processes that integrate data from various sources.The ideal candidate will be responsible for creating ETL pipelines using Informatica and other tools to process and transform large datasets. Key responsibilities include:Designing, developing,...

  • Advanced Data Engineering Professional

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 16,00,000

    Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to spearhead the development and implementation of large-scale data processing systems using AWS services.Key Responsibilities:Design and develop scalable data architectures to meet business requirements.Collaborate with cross-functional teams to identify and prioritize data...

  • Data Automation Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Automation SpecialistOur organization requires a meticulous and highly skilled Test Automation Engineer to join our Data & Analytics team.In this role, you will be responsible for Developing a Golden Model simulation utilizing Python.Creating and validating synthetic test data is also essential.You will collaborate closely with data engineers, QA...

  • Unlock Your Potential as a Data Engineering Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistWe are seeking a skilled Data Engineer to take on the challenge of designing and developing scalable data pipelines.Key Responsibilities:Develop high-performance data processing solutions using various tools and technologies.Collaborate with cross-functional teams to integrate data engineering solutions into business...

  • Data Engineering Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled data engineer to join our team. As a member of this team, you will design, develop, and operate data warehouses and platforms using agile methodologies.You should have 5-8 years of experience in Python programming.A proven track record as a data engineer or working on data engineering projects/platforms with 5+ years...

  • Data Engineering Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Data Engineer OpportunityAre you a skilled data engineer looking for a challenging role? We are seeking an experienced professional to join our team as a Data Engineer. In this position, you will be responsible for designing, developing, and maintaining scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Pipeline...

  • Senior Data Engineering Professional

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering Specialist Job DescriptionWe are seeking a seasoned data engineering professional to lead the design, development, and deployment of scalable data pipelines and ETL processes using Databricks.Key Responsibilities:Collaborate with stakeholders to understand business requirements and translate them into technical solutions.Design and develop...

  • Data Architecture Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeArchitecture Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Architecture SpecialistAt a high-growth startup, we thrive on bold thinking and rapid execution.This role enables data-driven decision making by designing and implementing scalable data architectures.Key ResponsibilitiesArchitect and implement data pipelines using Azure services.Build data models to ingest, index, and enrich data from diverse...