Data Systems Engineer

1 week ago

Kurnool, Andhra Pradesh, India beBeeAutomation Full time ₹ 12,00,000 - ₹ 15,00,000
Software Developer

Job Summary: We're seeking a skilled software developer to collaborate on client projects. In this role, you'll work closely with individuals across various departments to shape and innovate new products and features.

Key Responsibilities:

  • Collaborate with analysts to understand and anticipate requirements.
  • Design, implement, and maintain web scrapers for alternative datasets.
  • Perform data cleaning, exploration, transformation etc. of scraped data.
  • Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.
  • Author QC checks to validate data availability and integrity.
  • Maintain alerting systems and investigate time-sensitive data incidents.
  • Design and implement products and tools to enhance the web scraping platform.

Requirements:

  • Bachelor's/master's degree in computer science or related field.
  • 2-4 years of software development experience.
  • Strong Python and SQL/database skills.
  • Expertise in using Pandas library is required.
  • Experience with web technologies (HTML/JS, APIs etc.).
  • Proven work experience in working with large data sets for data cleaning, transformation, manipulation, and replacements.
  • Excellent verbal and written communication skills.
  • Aptitude for designing infrastructure, data products, and tools for data scientists.

Preferred Qualifications:

  • Familiarity with scraping and common scraping tools.
  • Experience containerizing workloads with Docker.
  • Experience with build automation.
  • Experience with AWS technologies.

What We Offer:

A large degree of independence and trust, but not isolation. The support of the engineering team leads, product team leads, and every other technology team member is behind you.

  • Data Systems Engineer

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeBackendEngineer Full time ₹ 80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are a global technology company that revolutionizes financial access for millions of underserved banking customers across Africa and India.We leverage smartphones, machine learning, and other technologies to improve access and value for those overlooked by banks.Role DescriptionAs a Backend Engineer at our organization, you will design and...

  • Large Scale Data Systems Engineer

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataInfrastructure Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Infrastructure SpecialistThis role involves designing and developing large-scale data systems, creating real-time data processing solutions using technologies like Kafka, Flink, and Spark.Create efficient data architectures to manage big dataDesign and implement real-time data processing pipelines using advanced technologiesDevelop robust...

  • Sensor & Machine Vision Engineer

    1 week ago

    Kurnool, Andhra Pradesh, India Pando Data Full time

    Sensor & Machine Vision EngineerAt Pando Data, we're on a mission to bring Industry 4.0 to life in factories that need it most. We design smart, affordable AI + sensor systems that actually work on the shop floor - from measuring steel bars flying out of a rolling mill, to spotting defects in plastic pipes, to preventing theft in dispatch yards.We're a...

  • Lead Data Engineer

    32 minutes ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: Data Engineering LeadAbout the Role:We are seeking an experienced data engineering professional with a strong foundation in data pipelines, data validation, and AI-enhanced quality frameworks. This role is responsible for building and maintaining high-quality data ingestion and validation processes from multiple upstream systems, while laying the...

  • Data Engineering Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,20,000

    Job Title: Data Engineering SpecialistWe require a skilled specialist with expertise in big data processing, cloud computing and data integration to work on data ingestion processes.This role involves the design, development, testing and deployment of data pipelines, automation tools and infrastructure management solutions for scalable and efficient data...

  • Senior Data Engineer

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time US$ 1,10,000 - US$ 1,40,000

    About the RoleThis is a highly sought-after position for a skilled professional in data engineering. We are seeking an individual with extensive experience and expertise in designing, building, and maintaining scalable and efficient data systems.The ideal candidate will have a deep understanding of data processing, automation, and orchestration tools, as...

  • Backend Systems Engineer

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeBackendSystemsEngineer Full time ₹ 25,00,000 - ₹ 40,00,000

    Job DescriptionWe are seeking an experienced Backend Systems Engineer to develop and maintain our core infrastructure for real-time pricing and analytics in DeFi. The successful candidate will have a strong background in backend development, specifically in Go or Rust.Key Responsibilities:Owning the development of event decoders for major DeFi protocols...

  • Distributed Data Systems Specialist

    4 hours ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ProfessionalWe are seeking a highly skilled data engineering professional to join our team. The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka.Design, develop, and optimize large-scale data pipelines and distributed data processing systems using Scala, Spark (PySpark), and Python.Develop...

  • Data Engineering Professional

    4 hours ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 7,00,000 - ₹ 14,00,000

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a proven track record of designing and implementing scalable data pipelines.AWSPythonPySparkDatabricksKey Responsibilities:Design and implement data pipelines using AWS servicesDevelop and...

  • Data Management Systems Engineer

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeSystems Full time ₹ 15,00,000 - ₹ 22,00,000

    We are seeking a skilled Systems Specialist to join our team. The ideal candidate will possess strong analytical skills and the ability to work collaboratively with cross-functional teams.Key Responsibilities:Develop and maintain accurate data within our Laboratory Information Management System (LIMS).Interface with multiple groups, interpret results, and...