Big Data

8 hours ago

Remote, India Technology Next Full time

**Big Data AI/ML Engineer**

**Experience**: 6 to 9 Yrs
**Location**:Remote
**Tenure:

- **6 Months
**Salary:

- ** 80K-90K In hand
**Notice**:Immediate Joiner

We are seeking a talented Data Engineer with AI & ML knowledge to join our team. As Data Engineer or ML Ops Engineer, your primary responsibility will be to develop & integrate ML solutions that focus on technology improvements. Specifically, you will be working on projects involving leveraging AI/ML for Data Management Efficiencies & Query Optimizations.

**Responsibilities**:

- Collaborate with cross-functional teams such as Data Scientists, Product Partners and Partner Team Developers to identify oppurtunities for Big Data, Query (Spark, Hive SQL, BigQuery, SQL) tuning opportunities that can be solved using machine learning and generative AI.
- Write clean, high-performance, high-quality, maintainable code.
- Design and develop Big Data Engineering Solutions & generative AI Applications for above ensuring scalability, efficiency, and maintainability of such solutions.
- Stay abreast of the latest advancements in the field of Generative AI Application Development and actively contribute to the research and development of new Generative AI Applications.

**Requirements**:

- A Master's or Ph.D. degree in Computer Science or a related field.
- Proven experience working as a Big Data & MLOps Engineer, with a focus on Python, Google Cloud, Spark, Spark SQL, BigQuery and Generative AI Applications.
- Deep understanding and experience in tuning Dataproc, BigQuery, Spark Applications.
- Solid knowledge of software engineering best practices, including version control systems (e.g., Git), code reviews, and testing methodologies.
- Experience with large language models (LLMs) & prompt engineering techniques, vector DB's ( Nice to have )
- Strong communication skills to effectively collaborate and present findings to both technical and non-technical stakeholders.
- Proven ability to adapt and learn new technologies and frameworks quickly.
- A proactive mindset with a passion for continuous learning and research.

**Job Types**: Full-time, Temporary
Contract length: 6 months

Pay: ₹80,000.00 - ₹90,000.00 per month

Schedule:

- Day shift
- Monday to Friday

**Education**:

- Master's (required)

**Experience**:

- total work: 9 years (required)
- Data Engineer: 7 years (required)
- AI & ML: 4 years (required)
- Google Cloud: 4 years (preferred)
- large language models (LMM): 4 years (preferred)
- Big Data & MLOps Engineer: 4 years (preferred)

Work Location: Remote

  • Big Data with Pyspark

    8 hours ago

    Remote, India Achutha Associates Full time

    **Job Title**: Big Data Engineer (PySpark) **Location**: Bengaluru, India **Experience**: 5+ years **Employment Type**: Full-time **Job Summary**: **Key Responsibilities**: - Design, develop, and maintain scalable **big data pipelines** using **PySpark** and other big data technologies. - Work with **Hadoop, Spark, Kafka, Hive, and other distributed data...

  • Big Data

    6 days ago

    Remote, India KEG HR Services Full time

    **Greetings From KEG HR Services!** Job Role: Big Data & Kubernetes Administrator Experience: 3 Years to 5 Years **Job Description**: - Install, configure, and maintain Cloudera Big Data clusters across multiple environments, ensuring optimal performance and resource utilization. - Ensure high availability and manage the performance of data services like...

  • Big Data Architect

    2 days ago

    Remote, India Databricks Full time

    As a **Big Data Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Architect - Big Data

    1 week ago

    Remote, India Databricks Full time

    CSQ125R88 As an **Architect (Big Data) **in our Professional Services team you will work with clients on short to medium term customer engagements on their **Big Data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Trainer

    2 days ago

    Remote, India REGex Software Services Full time

    Required Big Data Trainer who is expert in following topics: Python Introduction to LINUX Operating System and Basic LINUX commands Hadoop(HDFS) Hadoop 2.0 & YARN Sqoop Hive Programming PySpark ETL **Job Types**: Part-time, Contractual / Temporary, Freelance Contract length: 6-8 weeks Part-time hours: 10-12 per week **Salary**: ₹500.00 -...

  • Big Data Architect

    2 weeks ago

    Remote, India Databricks Full time

    CSQ424R34 As a** Big Data Architect **in our Professional Services team you will work with clients on short to medium term customer engagements on their **Big Data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Senior Big Data Engineer

    1 week ago

    Remote, India UMENIT SOLUTIONS LLP Full time ₹ 2,40,000 - ₹ 6,00,000 per year

    Job Title: Senior Big Data EngineerLocation: Remote / Hybrid (Preferred timezone overlap with [your region])Type: Full-time / ContractAbout the ProjectWe're building an intelligent data pipeline that brings SAP AO (Analysis Office) data into a central database, which will serve as the foundation for an AI-powered chatbot. This chatbot will help users...

  • Big Data Architect

    6 days ago

    Remote, India Databricks Full time

    As an **Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help...

  • Remote Junior Big Data Associate Job at Digistreem

    2 days ago

    Remote, India CollegeSearch Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    About the JobAs a Junior Big Data Associate at Digistreem, you'll have the opportunity to work with cutting-edge technology and be part of a dynamic team that is revolutionizing the way data is used in the digital world. Your role will be crucial in helping our clients make informed decisions based on data-driven insights.Key responsibilities:1. Utilize...

  • Google Cloud

    2 days ago

    Remote, India Optim Hire (LAD Software Solutions Pvt LTd) Full time

    Experience 7+ Years Requirement: From Big Query table which has high volume of data needs to expose as API with pagination, filtering and sorting and error handling. Ideally tech stack would be Google Cloud & Big Query(Exposing Big Query table as API) Python .Net We need a resource on T&M basis who can deliver the API, and he will be required for 6...