Data Engineering Specialist

2 days ago

Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 8,00,000
Job Title: Data Engineering Specialist

 

We are seeking an exceptional Data Engineering Specialist to join our team. As a key member of our organization, you will play a crucial role in shaping our technology vision and architecture.

This position is ideal for a highly motivated individual who thrives on early-stage challenges and loves building innovative, scalable solutions.

  • Key Responsibilities:
  • Design and develop automated data extraction systems to collect structured and unstructured data from various sources.
  • Craft multi-threaded, distributed crawlers to handle high-volume data collection without interruptions.
  • Normalize extracted data, remove noise, and ensure consistency before passing it to data pipelines.
  • Implement techniques such as proxy rotation, captcha solving, and request throttling to handle scraping restrictions.
  • Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
  • Maintain data accuracy, deduplicate records, and implement a trust scoring system for data confidence.
  • Keep data extraction systems updated when sources change, and document logic for reproducibility.

 

Required Skills and Qualifications:

  • 2+ years of experience in web scraping, crawling, or data collection.
  • Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
  • Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
  • Experience in handling large-scale scraping with proxy management and rate-limiting.
  • Basic knowledge of ETL processes and integration with data pipelines.
  • Exposure to graph databases (Neo4j) is a plus.

 

Benefits:

We offer a dynamic work environment, opportunities for growth and development, and a competitive compensation package.

 

Others:

We are united by a single mission - to provide innovative solutions to real-world problems. Our approach is defined by curiosity, innovation, and proactive action.

We encourage autonomy, accountability, and collaboration to drive success. Continuous learning and improvement are core to our success.

  • Data Engineering Specialist

    2 weeks ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 20,10,000

    Data Engineering SpecialistJob Title: Data Engineering SpecialistWe are seeking a skilled and motivated Data Engineering Specialist to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data.Key Responsibilities:Design and Implement Scalable Data PipelinesBuild and maintain ETL/ELT...

  • Data Engineering Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Data Engineering SpecialistThis is a 100% remote position for an experienced Data Engineer who can work with our team to design and build scalable data pipelines using cloud-based technologies, such as Azure, Snowflake, and Python.

  • Data Engineering Specialist

    7 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Data Engineering SpecialistThis is a critical role for our organization, and we're seeking a highly skilled data engineer to join our team. The ideal candidate will have a strong background in Python programming, as well as hands-on experience with large datasets, data cleaning, analysis, and visualization.

  • Data Engineering Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistThe ideal candidate will possess a solid foundation in data engineering, with experience in data processing and documentation. They should be proficient in SQL and have knowledge of the Scrum methodology.Key Skills:Strong understanding of Scrum principlesAdvanced SQL expertise (Essential)Background in data engineering...

  • Data Engineering Specialist

    6 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled professional to lead the design and implementation of data engineering pipelines that provide actionable insights.About the Role:The ideal candidate will be a technical expert with hands-on experience in coding, cloud platforms, and network analytics.Key Responsibilities:Develop data...

  • Senior Data Engineering Specialist

    7 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering SpecialistSummaryA highly experienced professional with 6+ years of expertise in development and maintenance in data engineering projects.Key Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical solutions, ensuring seamless integration and optimal...

  • Cloud Data Engineering Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,20,00,000

    Cloud Data Engineer SpecialistJob Description:We are seeking a highly skilled Cloud Data Engineer to design, develop and maintain scalable data pipelines and ETL/ELT solutions using AWS cloud services. The ideal candidate will have expertise in ETL/ELT development using PySpark, Python, or SQL, and experience with data modeling, warehousing and performance...

  • Unlock Your Potential as a Data Engineering Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a seasoned Data Engineering Specialist to design and implement scalable data pipelines using Microsoft Fabric. The ideal candidate will have 6-9 years of experience in ETL/ELT solutions, data storage, and compute optimization within Azure Synapse.About the RoleDevelop efficient data processing solutions using PySpark, T-SQL, and...

  • Data Engineering Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,60,000

    Unlock Your Data PotentialWe are seeking an experienced Data Engineering Expert to join our team. As a seasoned professional, you will play a pivotal role in guiding our clients' data modernization journey.With over 15 years of experience as a premier global provider of multi-cloud management and cloud-native application development solutions, we've...

  • Data Transformation Specialist

    6 days ago

    Vizag, Andhra Pradesh, India beBeeTransformation Full time ₹ 15,12,000 - ₹ 20,16,000

    Job Opportunity:We are seeking a skilled Data Transformation Specialist to join our data engineering team. The ideal candidate will have experience in designing, developing, and maintaining ETL pipelines using IBM DataStage, AWS Glue, and Snowflake.Main Responsibilities:Design and develop efficient ETL pipelines using IBM DataStage and AWS Glue for data...