Senior Large Scale Data Developer

12 hours ago

Chennai, Tamil Nadu, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000
Job Title: Data EngineerJob Description:

We are looking for a skilled professional to design, develop and maintain large-scale data systems.

  • Key Responsibilities:
  • Bachelor's or master's degree with 3+ years of experience in Computer Science, Data Science, Engineering, or a related field.
  • Proficient in software development lifecycle and software engineering practices.
  • Developing and maintaining robust data pipelines for both structured and unstructured data to be used by Data Scientists to build ML Models.
  • Working with Cloud Data Warehousing platforms and experience in working with distributed frameworks like Spark.
  • Familiarity with commonly used machine learning libraries (like scikit-learn, xgboost).
  • Understanding of REST APIs and experience in using different types of APIs to either extract data or perform a functionality exposed by APIs.
  • Familiarity in Pythonic API development frameworks like Flask / FastAPI.
  • Experience in using containerization frameworks like Docker / Kubernetes.
  • Excellent communication skills and ability to work and collaborate with cross functional teams across technology and business.

Requirements:

  • 3+ years of experience in working with Python, SQL, PySpark and bash scripts.
  • 2+ years of hands-on experience in using Databricks platform for data engineering.
  • Detailed knowledge of Delta Lake, Databricks Workflow, Job Clusters, Databricks CLI, Databricks Workspace etc.
  • Hands-on experience in building and maintaining tools and libraries which have been used by multiple teams across organization.
  • Proficient in understanding and incorporating software engineering principles in design & development process.
  • Familiarity with CI/CD tools (e.g., Jenkins or equivalent), version control (Github, Bitbucket), Orchestration (Airflow, Prefect or equivalent).

  • Senior Data Engineer – Large-Scale Solutions Specialist

    1 day ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job TitleSenior Data Engineer – Large-Scale Solutions SpecialistWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and optimizing large-scale data processing solutions using PySpark and Python.

  • Senior Large Scale Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Developer JobWe are seeking a highly skilled Big Data Developer to join our dynamic team. The ideal candidate will have expertise in designing and implementing large-scale data processing systems using modern data technologies.The role involves designing, developing, and maintaining scalable Big Data solutions using Hadoop ecosystem, Spark, and...

  • Large Scale Data Processing Specialist

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    GCP Data Engineer PositionWe are seeking a highly skilled data engineer to join our organization.This individual will be responsible for designing, developing, and maintaining large-scale data processing systems on Google Cloud Platform.Expertise in Snowflake data warehousing is required, including SQL, Snowpipe, Streams, and data sharing.Collaboration with...

  • Program Manager

    7 days ago

    Chennai, Tamil Nadu, India beBeeProgramManager Full time US$ 1,80,000 - US$ 2,50,000

    Job TitleProgram Manager - Large Scale Initiatives">About the RoleThis position involves overseeing and executing large-scale programs, ensuring they meet business objectives. You will work closely with cross-functional teams to drive initiatives and communicate progress to senior stakeholders.ResponsibilitiesDevelop and manage program scope, milestones, and...

  • Expert Large Scale Data Processing Professional

    4 days ago

    Chennai, Tamil Nadu, India beBeeSoftwareEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Big Data EngineerThe role of a Software Engineer (Data) is crucial in the development of large-scale data processing systems for LLM research. We are seeking an experienced professional with deep expertise in designing, building, and operating scalable data infrastructure to support distributed computing and data orchestration.Key...

  • Optimizing Large-Scale HPC Platforms

    1 day ago

    Chennai, Tamil Nadu, India beBeeHighperformance Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Linux Engineer - Quantitative ResearchWe are seeking an experienced Linux engineer to lead the design, engineering, and automation of large-scale High-Performance Computing (HPC) platforms for quantitative finance and advanced research.Develop and manage scalable HPC environments with a focus on performance optimization.Research and experiment with...

  • Software Development Senior Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Development Senior Specialist to join our team in Chennai, Tamil Ndu (IN-TN), India (IN).Job Description:This...

  • Senior Cloud Engineer for Large Scale Architecture

    1 week ago

    Chennai, Tamil Nadu, India beBeeSoftwareEngineering Full time US$ 2,00,000 - US$ 2,50,000

    Job OpportunityWe are seeking a seasoned Engineering Manager of Software Development to spearhead our team in modernizing our platform on Cloud.As a hands-on leader, you will be responsible for collaborating with Product, Enterprise Solution Architects, Scrum Masters, and the leadership team to translate requirements into a scalable software architecture...

  • Large Scale Distributed Computing Solutions Expert

    1 week ago

    Chennai, Tamil Nadu, India beBeeExpert Full time ₹ 18,00,000 - ₹ 22,00,000

    Job Title:We are seeking a seasoned software development expert to design and build large-scale distributed computing solutions.As a senior developer, you will drive the team's technical direction, strategize and shape our long-term vision and architecture. You will own major deliverables end-to-end, drive roadmaps, and provide technical leadership to the...

  • Enterprise-Scale AI Systems Developer

    4 days ago

    Chennai, Tamil Nadu, India beBeeAI Full time US$ 2,00,000 - US$ 2,50,000

    We are seeking a seasoned expert to spearhead the development and deployment of cutting-edge AI systems at scale. The ideal candidate will possess a strong foundation in deep learning, reinforcement learning, or robotics.This role bridges AI research and production engineering, requiring the ability to experiment with LLMs, synthetic data, and large-scale...