Data Scientist

2 weeks ago


PuneHyderabadBangaloreChennai, India CalTech IT Solution Full time

Job Title: Data Engineer

Job Summary:

At CalTech IT Solution, we are seeking an experienced Data Engineer to join our team. This role will involve designing, developing, and maintaining scalable data processing solutions using Azure Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data processing and transformation using Azure Databricks.

Key Responsibilities:

  • Design and develop scalable data processing solutions using Azure Databricks.
  • Perform complex data transformations using PySpark or Python to ensure data quality and consistency.
  • Build and optimize end-to-end data pipelines from data ingestion to consumption within a big data architecture.
  • Develop and implement data integration solutions to support analytics and reporting needs.
  • Schedule, monitor, and manage ETL jobs using Oozie, Airflow, or other scheduling tools.
  • Ensure reliable and timely execution of data pipelines and workflows.
  • Work with large-scale datasets using distributed computing frameworks.
  • Collaborate with cross-functional teams to design and implement data solutions that align with business requirements.
  • Optimize data processing workflows for performance and scalability.
  • Troubleshoot and resolve issues related to data processing and pipeline failures.
  • Document data engineering processes, including design specifications, test cases, and operational procedures.
  • Collaborate with data scientists, analysts, and other engineers to ensure seamless data flow across systems.

Requirements:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 5+ years of experience in data engineering, with a focus on data processing and transformation using Azure Databricks.
  • Proven experience with PySpark or Python for complex data transformations.
  • Hands-on experience in building and managing data pipelines using Azure Databricks.
  • Strong programming skills in Python, Java, and/or Scala.
  • Experience with big data technologies and frameworks.
  • Proficiency in job scheduling tools such as Oozie, Airflow, or similar ETL schedulers.
  • Familiarity with distributed computing and big data architectures.

Preferred Qualifications:

  • Master's degree in Computer Science, Information Technology, or a related field.
  • Experience with cloud-based data platforms and services.
  • Knowledge of data governance and security best practices.

What We Offer:

  • A competitive salary and benefits package.
  • The opportunity to work with a dynamic team of professionals.
  • A collaborative and supportive work environment.
  • The chance to develop your skills and advance your career.

How to Apply:

Please submit your resume and a cover letter explaining why you are the ideal candidate for this role. We look forward to hearing from you.


  • Data Scientist

    4 weeks ago


    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data ScientistJob Summary:We are seeking a highly skilled Data Scientist to join our team in Hyderabad, Telangana, India. As a Data Scientist, you will be responsible for designing and developing advanced data models, algorithms, and statistical techniques to extract insights from complex data sets.Key Responsibilities:Develop and maintain test...

  • Data Scientist

    3 weeks ago


    Pune, India Data Dynamics Full time

    Job Title: Data ScientistJob Summary:Data Dynamics is seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will be responsible for developing and deploying machine learning models to solve complex business problems.Key Responsibilities:Design, develop, and deploy custom machine learning models to solve complex business...

  • Data Scientist

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data ScientistJob Summary:NTT DATA Services is seeking a highly skilled Data Scientist to join our team in Hyderabad, Telangana, India. As a Data Scientist, you will be responsible for designing and developing advanced data analytics solutions to drive business growth and improve operational efficiency.Key Responsibilities:Develop and maintain...

  • Data Scientist

    2 weeks ago


    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data ScientistJob Summary:We are seeking a highly skilled Data Scientist to join our team in Hyderabad, Telangana, India. The successful candidate will be responsible for creating and maintaining test deliverables and artifacts to test complex applications and system integrations for Finance applications.Key Responsibilities:Programming Languages:...

  • Data Scientist

    5 months ago


    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Data Scientists

    5 months ago


    Hyderabad, Telangana, India NTT DATA Full time

    **Req ID**: 276502 We are currently seeking a Data Scientists to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data Scientists Responsibilities - Programming Languages (Pyton, R), Data Manipulation and Analysis Tools, Machine Learning Libraries, Data Visualization tools, Cloud Platforms Programming Languages (Pyton, R), Data Manipulation and...

  • Data Scientist

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID: 276502NTT DATA Services is a recognized leader in IT and business services, including cloud, data, and applications. We are seeking a Data Scientist to join our team in Hyderabad, Telangana, India.Data Scientist ResponsibilitiesProgramming Languages (Python, R), Data Manipulation and Analysis Tools, Machine Learning Libraries, Data...

  • Data Scientists

    4 months ago


    Hyderabad, India NTT DATA Full time

    Job Description Req ID: 276502 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Scientists to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Scientists...

  • Data Scientist

    1 week ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking a highly skilled Data Analyst to join our engineering team at data.ai. As a Data Analyst, you will play a vital role in delivering high-quality app market data to app professionals.The successful candidate will be responsible for data profiling, data cleansing, data quality monitoring, and root cause analysis. You will work...

  • Data scientist

    3 weeks ago


    Chennai, India Crayon Data Full time

    Role: Sr Data Scientist Experience level: 5 to 8 years Location: Chennai Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai,...

  • Data Scientist

    3 weeks ago


    Chennai, India Crayon Data Full time

    Role: Sr Data Scientist Experience level: 5 to 8 years Location: Chennai Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Data Scientist

    5 days ago


    Pune, Maharashtra, India NTT DATA Services Full time

    About the Role:We are currently seeking a Data Scientist to join our team in an exciting and varied data-driven project. As a key player in our Anti Financial Crime Technology team, you will work on cutting-edge technology to transform the bank's Anti Financial Crime processes.Your Key Responsibilities:Analysing data sets and designing and coding stable and...

  • Data Scientist

    1 week ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    About the Role:We are seeking a highly skilled Data Scientist to join our Business Intelligence team. As a Data Scientist, you will be responsible for analyzing complex data sets to gain valuable insights for business decision-making. The ideal candidate will have a strong background in data analysis, machine learning, and business acumen. If you have a...

  • Data Scientist

    5 months ago


    Chennai, India Crayon Data Full time

    Role: Data Scientist Experience level: 3+ years Location: Chennai Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Data Scientist

    1 month ago


    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 8 yearsLocation: ChennaiWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Data Scientist

    2 months ago


    chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 8 yearsLocation: ChennaiWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Data Scientist

    2 months ago


    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 8 yearsLocation: ChennaiWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Data Scientist

    2 months ago


    Chennai, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 8 yearsLocation: ChennaiWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...

  • Data Scientist

    2 months ago


    Chennai, India Crayon Data Full time

    Role: Sr Data Scientist Experience level: 5 to 8 years Location: Chennai Who are we? Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Data ScientistExperience level: 5 to 8 yearsLocation: ChennaiJob overview:As a member of our Data Science team at Crayon Data, you will be responsible for developing and implementing machine learning and deep learning models to improve innovation within our Knowledge Graph curation. Your success will result in informed decision-making and...