Current jobs related to Senior Big Data Engineer - Remote, IN - MindBrain

  • Senior Data Engineer

    2 days ago

    Remote, India VAST Consulting Full time

    About the role : We are seeking a highly skilled and experienced Senior Data Engineer with expertise in Big Data Technologies, Graph Databases, Streaming/Batch Data Analytics and strong understanding of multiple clouds platforms to join our talented team. The ideal candidate should have a proven trach record of solving complex data solution and implementing...

  • Big Data

    4 months ago

    Remote, India Technology Next Full time

    **Big Data AI/ML Engineer** **Experience**: 6 to 9 Yrs **Location**:Remote **Tenure: - **6 Months **Salary: - ** 80K-90K In hand **Notice**:Immediate Joiner We are seeking a talented Data Engineer with AI & ML knowledge to join our team. As Data Engineer or ML Ops Engineer, your primary responsibility will be to develop & integrate ML solutions that...

  • Architect - Big Data

    3 months ago

    Remote, India Databricks Full time

    CSQ125R88 As an **Architect (Big Data) **in our Professional Services team you will work with clients on short to medium term customer engagements on their **Big Data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Architect

    4 months ago

    Remote, India Databricks Full time

    CSQ225R24 As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their **big data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and...

  • Data Engineering Lead

    2 days ago

    Remote, India VAST Consulting Full time

    About the role : We are seeking a highly skilled and experienced Lead Data Engineers with expertise in architecting and building complex solutions using Big Data Technologies, Graph Databases, Streaming/Batch Data Analytics with strong understanding of multiple clouds platforms to join our talented team. The ideal candidate should have strong leadership...

  • Big Data/ETL Test Engineer

    3 months ago

    Remote, India Gama Advisory Services LLP Full time

    Overview :We are seeking a proficient Big Data/ETL Test Engineer with 4-6 years of experience in testing Big Data platforms and ETL processes, specifically using Hadoop and Hive technologies. As a Test Engineer, you will play a critical role in ensuring the quality and reliability of our Big Data solutions by designing and executing comprehensive test...

  • Architect : Big Data

    3 months ago

    Remote, India Databricks Full time

    CSQ225R23 As a** Resident Solutions Architect (Big Data)**, you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Big Data Architect

    3 months ago

    Remote, India Databricks Full time

    CSQ424R34 As a** Big Data Architect **in our Professional Services team you will work with clients on short to medium term customer engagements on their **Big Data challenges using the Databricks platform**. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Java Developer

    3 months ago

    Remote, India Gama Advisory Services LLP Full time

    Overview :We are looking for a talented Java Developer with 2-3 years of experience in Big Data technologies to join our team. As a Java Developer specializing in Big Data, you will be responsible for designing, developing, and maintaining scalable applications and data pipelines using Java and Big Data frameworks. Your expertise in Java programming and Big...

  • Big Data

    3 months ago

    Remote, India KEG HR Services Full time

    **Greetings From KEG HR Services!** Job Role: Big Data & Kubernetes Administrator Experience: 3 Years to 5 Years **Job Description**: - Install, configure, and maintain Cloudera Big Data clusters across multiple environments, ensuring optimal performance and resource utilization. - Ensure high availability and manage the performance of data services like...

  • Big Data Architect

    4 months ago

    Remote, India Redian Software Full time

    **Job Information**: Work Experience **12 years-18 years** *** Industry **IT Services** *** Salary **As Per Market Standard** *** **Remote Job** **Requirements**: - Would prefer some health insurance data experience. - Need to understand distributed computing and data warehousing. - Should have extensive experience in Big Data Architect. - Database...

  • Big Data Architect

    3 months ago

    Remote, India Databricks Full time

    As an **Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help...

  • Senior Big Data Engineer

    4 days ago

    Remote, India MindBrain Full time

    Roles & Responsibilities : - Sound knowledge in Spark architecture and distributed computing - Proficient in Spark - including RDD and Dataframes core functions, troubleshooting and performance tuning. - Good understanding in object-oriented concepts and hands on experience on Scala or on java with excellent programming logic and technique - Good in...

  • Azure Data Architect

    4 months ago

    Remote, India Data PlatformExperts Full time

    **Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...

  • Data Scientist

    3 months ago

    Remote, India Georgia IT, Inc. Full time

    Job Description : - We are seeking a skilled Data Scientist / Data Analyst with a solid background in Python programming, SQL, and data visualization. - The ideal candidate will have at least 3 years of relevant experience in data science or data analysis, with specific expertise in NLP techniques and LLM. - This role requires a creative problem-solver...

  • Aptus Data Labs

    3 months ago

    Remote, India Aptus Data Labs Full time

    Description : We are seeking a highly skilled and experienced individual to join our team as a Data Governance expert with AWS knowledge. In this role, you will play a critical role in ensuring data integrity, quality, and security across our organization's data assets. As a data governance expert, your main responsibility will be to develop and...

  • Content Writer and Editor

    12 hours ago

    Remote, India Big Shout Design Full time

    **About Big Shout Design** Big Shout Design is a leading UI/UX design and digital marketing agency dedicated to delivering high-impact solutions. We believe in authentic storytelling and producing content that resonates with our audience. We are looking for a skilled **Content Writer** who is passionate about crafting compelling, AI-free, plagiarism-free,...

  • Azure Data Architect

    4 months ago

    Remote, India Data PlatformExperts Full time

    Job Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...

  • Senior Data Engineer

    4 months ago

    Remote, India Nthinsight Full time

    Job Description : We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with...

  • Data Architect

    3 months ago

    Remote, India Thinkreh Full time

    Hiring Azure Data Architects - Remote Minimum Exp - 10 Years Only immediate joiners shall apply Experience Experience of working with large, event based, datasets in an enterprise environment. Minimum 10 years within an Azure or SQL Data Engineering environment Engineering and database skills in SQL Server and/or Azure (Data Factory, Synapse) and the...

Senior Big Data Engineer

3 months ago

Remote, IN MindBrain Full time

Roles & Responsibilities :


- Sound knowledge in Spark architecture and distributed computing


- Proficient in Spark - including RDD and Dataframes core functions, troubleshooting and performance tuning.


- Good understanding in object-oriented concepts and hands on experience on Scala or on java with excellent programming logic and technique


- Good in functional programming and OOPS concept either on Scala or Java


- Good experience in SQL - should be able to write complex queries.


- Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.


- Able to mentor new members for onboarding to the project.


- Understand the client requirement and able to design, develop from scratch and deliver


- AWS cloud experience would be preferable.


- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services


- DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)


- Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)


- Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS(preferred)


- Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.


- Managing project timing, client expectations and meeting deadlines.


- Should have played project and team management roles.


- Facilitate meetings within the team on regular basis.


- Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.


- Optimization, maintenance, and support of pipelines.


- Strong analytical and logical skills.


- Ability to comfortably tackling new challenges and learn


Must have Skills :


- Must have relevant Big Data experience of at least 3 years


- Must have experience in Scala/Java. (Not Python or Pyspark)


- Must have experience in Spark


- AWS preferable/Any cloud


- SQL (Intermediate to advanced level)


- Object-Oriented Programming


- Good knowledge on ETL/ELT processes and tools


Good to Have Skills :


- AWS Certification


- Basic knowledge of streaming


- Knowledge on hive, Hadoop, Kafka, Streaming


- Git/similar version control tool


- Knowledge in CI/CD, Microservices

(ref:hirist.tech)