Data Engineering Specialist

16 hours ago

Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000
Software Engineer - Data Engineering Specialist

Job Description:

We are seeking a highly skilled and innovative Software Engineer to join our team as a Data Engineering Specialist. In this role, you will be responsible for designing and developing new features and enhancements for our core platforms and services.

The ideal candidate will have strong hands-on experience with Python and its standard libraries, as well as expertise in implementing message queues and task distribution using RabbitMQ. Experience with containerizing applications and managing services using Docker & Docker Compose is also highly desirable.

You will work on a mix of new feature development, system enhancements, and platform modernization initiatives while ensuring the stability and reliability of our core products. You will have the opportunity to experiment with and implement GenAI-driven approaches, innovations, and new strategies as we continue to evolve our solutions.

As a Data Engineering Specialist, you will contribute to the modernization and refactoring of existing systems and code bases. You will propose, experiment with, and implement GenAI-based innovations, tools, or workflows to solve business problems and create new value.

Key Responsibilities:

  • Design and develop new features and enhancements for our core platforms and services.
  • Contribute to the modernization and refactoring of existing systems and code bases.
  • Propose, experiment with, and implement GenAI-based innovations, tools, or workflows to solve business problems and create new value.
  • Drive technical improvements, suggest and lead platform upgrades, and champion engineering best practices.
  • Investigate, debug, and resolve production issues, to deliver robust solutions that improve performance and maintainability.
  • Collaborate with product, engineering, and business teams to deliver impactful end-to-end solutions.

Technical Skills & Requirements:

  • Python: Strong hands-on experience with core Python and its standard libraries.
  • RabbitMQ: Proficiency in implementing message queues and task distribution.
  • Docker & Docker Compose: Experience containerizing applications and managing services.
  • Web Scraping: Demonstrated expertise with webscraping tools and techniques.
  • Playwright & Selenium: Practical experience with browser automation frameworks.
  • PostgreSQL & SQLAlchemy: Proficient in SQL and ORM-based data access.
  • MongoDB & PyMongo: Experience with NoSQL data using PyMongo.
  • Redis: Practical use for caching and lightweight messaging.
  • AWS: Hands-on experience with services such as S3, Secrets Manager, and Auto Scaling Groups (using boto3).
  • Linux/Unix: Comfort with command-line operations and scripting.
  • Git: Proficient in version control and team collaboration.
  • Concurrency: Experience with multithreading and asynchronous programming in Python.
  • API Integrations: Familiarity with integrating third-party APIs, including authentication, data handling, and rate limiting.

Other Infrastructure Requirements:

To excel in this role, you will require:

High-speed internet connectivity for video calls and efficient work.

Capable business-grade computer (e.g., modern processor, 8 GB+ of RAM).

Headphones with clear audio quality.

Stable power connection and backups in case of internet/power failure.

  • Data Engineering Specialist

    3 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineering SpecialistDesign, build and maintain robust data pipelines for processing channel activity data from multiple sources.As a key player in our digital solutions team, you will focus on integrating and processing data from various channels, including Hadoop and Terradata environments. Your expertise in cloud technologies,...

  • Data Engineering Specialist

    4 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistJob Description:In this role, you will be responsible for designing, developing, and maintaining large-scale data pipelines using the Google Cloud Platform. You will work closely with stakeholders to understand business requirements and develop solutions that meet their needs.Key Responsibilities:Develop data acquisition...

  • Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeDataMigration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Migration SpecialistWe are seeking a skilled professional with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Lead large-scale...

  • Cloud Data Specialist

    7 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistWe are seeking a highly skilled and experienced Cloud Data Specialist to design and develop scalable data processing workflows using Azure Cloud technologies, Python, Scala, Spark (PySpark & Scala Spark), and data management principles.Key Responsibilities:Design and Develop Efficient ETL Pipelines: Create optimized ETL...

  • Data Engineering Specialist

    1 week ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,81,20,000 - ₹ 2,01,60,000

    Are you looking for a challenging role in data engineering?We are seeking a skilled data engineer to join our team.About the Role:Create data pipelines to collect, process and analyze data from various sources.Develop expertise in AWS Cloud services including Lambda, DMS and Glue.Familiarity with data warehousing concepts using Snowflake.Implement complex...

  • Senior Data Foundation Specialist

    1 day ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000

    Job Title: Senior Data Foundation SpecialistWe are seeking an experienced Data Engineer to lead the design and development of our data foundations and end-to-end solutions. This role will be instrumental in driving business value from data, fostering a data-driven culture across the organization, and developing strategic partnerships with key...

  • Data Engineering Specialist

    1 day ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Position OverviewThis role focuses on designing and implementing large-scale data processing systems to drive business growth through data-driven insights.

  • Data Architect Specialist

    17 hours ago

    Alleppey, Kerala, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Architect Specialist Overview: We are seeking an experienced Data Architect Specialist to lead the design and implementation of our data architecture. The ideal candidate will have a strong background in PostgreSQL, with expertise in advanced query writing, CTEs, window functions, indexing, and optimization. They will also possess...

  • Data Innovations Specialist

    1 day ago

    Alleppey, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity: Data EngineerWe are seeking an experienced and innovative data specialist with a strong background in Generative AI GenAI and complementary expertise in Computer Vision and Predictive Modeling.About the Role:Lead and contribute to applied research in Generative AI including LLMs VisionLanguage Models VLMs Multimodal AI and Prompt...

  • Data Insights Specialist

    10 hours ago

    Alleppey, Kerala, India beBeeData Full time ₹ 20,25,000 - ₹ 26,25,000

    Data Insights SpecialistWe are seeking a highly experienced and technically versatile Data Insights Specialist on a fixed 2-month contract with a potential for extension to deliver data-driven initiatives across the business.Deep expertise in data mining, statistical modeling, algorithm development, and simulation design is required.You will work closely...