Big Data

4 days ago

Remote, India Technology Next Full time

**Big Data AI/ML Engineer**

**Experience**: 6 to 9 Yrs
**Location**:Remote
**Tenure:

- **6 Months
**Salary:

- ** 80K-90K In hand
**Notice**:Immediate Joiner

We are seeking a talented Data Engineer with AI & ML knowledge to join our team. As Data Engineer or ML Ops Engineer, your primary responsibility will be to develop & integrate ML solutions that focus on technology improvements. Specifically, you will be working on projects involving leveraging AI/ML for Data Management Efficiencies & Query Optimizations.

**Responsibilities**:

- Collaborate with cross-functional teams such as Data Scientists, Product Partners and Partner Team Developers to identify oppurtunities for Big Data, Query (Spark, Hive SQL, BigQuery, SQL) tuning opportunities that can be solved using machine learning and generative AI.
- Write clean, high-performance, high-quality, maintainable code.
- Design and develop Big Data Engineering Solutions & generative AI Applications for above ensuring scalability, efficiency, and maintainability of such solutions.
- Stay abreast of the latest advancements in the field of Generative AI Application Development and actively contribute to the research and development of new Generative AI Applications.

**Requirements**:

- A Master's or Ph.D. degree in Computer Science or a related field.
- Proven experience working as a Big Data & MLOps Engineer, with a focus on Python, Google Cloud, Spark, Spark SQL, BigQuery and Generative AI Applications.
- Deep understanding and experience in tuning Dataproc, BigQuery, Spark Applications.
- Solid knowledge of software engineering best practices, including version control systems (e.g., Git), code reviews, and testing methodologies.
- Experience with large language models (LLMs) & prompt engineering techniques, vector DB's ( Nice to have )
- Strong communication skills to effectively collaborate and present findings to both technical and non-technical stakeholders.
- Proven ability to adapt and learn new technologies and frameworks quickly.
- A proactive mindset with a passion for continuous learning and research.

**Job Types**: Full-time, Temporary
Contract length: 6 months

Pay: ₹80,000.00 - ₹90,000.00 per month

Schedule:

- Day shift
- Monday to Friday

**Education**:

- Master's (required)

**Experience**:

- total work: 9 years (required)
- Data Engineer: 7 years (required)
- AI & ML: 4 years (required)
- Google Cloud: 4 years (preferred)
- large language models (LMM): 4 years (preferred)
- Big Data & MLOps Engineer: 4 years (preferred)

Work Location: Remote

  • Big Data with Pyspark

    4 days ago

    Remote, India Achutha Associates Full time

    **Job Title**: Big Data Engineer (PySpark) **Location**: Bengaluru, India **Experience**: 5+ years **Employment Type**: Full-time **Job Summary**: **Key Responsibilities**: - Design, develop, and maintain scalable **big data pipelines** using **PySpark** and other big data technologies. - Work with **Hadoop, Spark, Kafka, Hive, and other distributed data...

  • Big Data Architect

    5 days ago

    Remote, India Databricks Full time

    As a **Big Data Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Architect - Big Data

    2 weeks ago

    Remote, India Databricks Full time

    CSQ125R88 As an **Architect (Big Data) **in our Professional Services team you will work with clients on short to medium term customer engagements on their **Big Data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Trainer

    5 days ago

    Remote, India REGex Software Services Full time

    Required Big Data Trainer who is expert in following topics: Python Introduction to LINUX Operating System and Basic LINUX commands Hadoop(HDFS) Hadoop 2.0 & YARN Sqoop Hive Programming PySpark ETL **Job Types**: Part-time, Contractual / Temporary, Freelance Contract length: 6-8 weeks Part-time hours: 10-12 per week **Salary**: ₹500.00 -...

  • Big Data Engineer

    2 weeks ago

    Remote, India Sureminds Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    5+ years of experience as a Big Data Engineer with a strong focus on Apache Spark and Databricks.Proficiency in Scala for data processing and transformation.Experience with version control systems, particularly Git and GitHub.Strong knowledge of cloud computing platforms, with a preference for experience with Azure.Hands-on experience with Azure Data Factory...

  • Big Data Architect

    2 days ago

    Remote, India Databricks Full time

    CSQ225R24 As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their **big data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and...

  • Big Data Eng_Roji_Tookiaki

    1 week ago

    remote, India Coders Brain Technology Full time

    Job Title: BigData Engineer Reporting to: Technical Lead Location: India Requirements: Our ideal candidate will have the following responsibilities: ● Owning and delivering installation and configuration of AI products. ● Participating in solution architecture discussions to estimate hardware sizing. ● Analysing defects and conducting effective...

  • Data Architect

    2 days ago

    Remote, India Alphawizz Technologies Pvt. Ltd. Full time

    **Job Title**: Data Architect (Cloud | Big Data | Analytics) **Location**: Remote **Experience**: Minimum 10+ years in data architecture, engineering, or related roles **Tech Stack Includes**: AWS Redshift | GCP BigQuery | Azure Synapse | Apache Spark | Airflow | dbt | Hadoop | Snowflake | PostgreSQL | MySQL | MongoDB | Kafka | Flink | Tableau | Power BI |...

  • Sr. Big Data Engineer

    2 weeks ago

    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R34As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical...

  • Big Data Lead Engineer_DGLiger

    2 weeks ago

    Remote, India Coders Brain Technology Full time ₹ 2,00,00,000 - ₹ 4,00,00,000 per year

    Must to have skills: Pyspark, SQL, Cloud computing(AWS/Azure or any other cloud)   JOB DESCRIPTION § Work with extremely talented peers in a client environment to build new and enhance/maintain existing PySpark, Python codes that generates analytics insights leveraging the big data environment in AWS § Proficiency in SQL Writing, SQL Concepts, Data...