Big Data Engineer

4 weeks ago

Mumbai, Maharashtra, India Bitkraft Technologies Full time

Summary :

Bitkraft Technologies LLP is looking for Big Data Engineer to join our software engineering team. You will be working across the stack on cutting edge web development projects for our custom services business.

As a Big Data Engineer, you play a pivotal role in designing, developing, and implementing cutting-edge data processing solutions. The ideal candidate will have a deep understanding of distributed systems, big data technologies, and real-time data processing frameworks.

If you love solving problems, are a team player and want to work in a fast paced environment with core technical and business challenges, we would like to meet you.

Essential Skills :

- Deep understanding of big data technologies, including Hadoop, Spark, Kafka, and Flink.

- Proven experience in designing and implementing scalable, high-performance data processing solutions.

- Strong knowledge of real-time data processing concepts and frameworks.

- Familiarity with cloud platforms (AWS, Azure, GCP) and container orchestration (Kubernetes).

- Experience working in a fast-paced, data-driven environment and handling large-scale data.

Other Essential Skills / Requirements :

- Great attention to detail

- Strong work ethic and commitment to meet deadlines and support team members meet goals

- Be flexible with working across time zones with overseas customers if required

- Ability to work independently and as part of a team.

Desirable Skills :

- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

- Knowledge of machine learning pipelines or data science workflows.

- Experience in real-time data processing and stream processing using technologies like Apache Kafka or Apache Flink.

Key Responsibilities :

- Design, develop, and maintain scalable and efficient data pipelines to process and transform large datasets from diverse sources (structured, unstructured, and semi-structured).

- Architect and optimize big data platforms, databases, and technologies (e.g., Hadoop, Spark, Kafka, AWS, GCP, etc.) for high performance data processing and storage.

- Develop and optimize ETL (Extract, Transform, Load) processes to move data across systems and ensure data integrity, quality, and accuracy.

- Integrate data from various sources (internal and external) into a centralized data warehouse or lake.

- Optimize data processing and storage performance for large datasets, ensuring scalability and efficiency.

- Work closely with data scientists, analysts, and business teams to understand data requirements and deliver solutions to meet business needs.

- Implement automation for data workflows and set up monitoring systems to ensure the reliability and performance of data pipelines.

- Ensure proper data governance and security practices are in place, adhering to organizational and regulatory compliance requirements.

- Investigate and resolve issues related to data integrity, pipeline failures, and system performance.

Experience : 5 to 10 years

Location : Fort, Mumbai

Why join Bitkraft :

- Your inputs and opinions are valued

- Exposure to latest technologies

- Working directly with client teams

- International project experience

- You get to see the big picture on the project

- Fast paced environment with quick project completions

- Manage your own time for efficient working

- A friendly and easy going work environment

About Bitkraft Technologies LLP :

Bitkraft Technologies LLP is an award winning Software Engineering Consultancy focused on Enterprise Software Solutions, Mobile Apps Development, ML/AI Solution Engineering, Extended Reality, Managed Cloud Services and Technology Skill-sourcing, with an extraordinary track record.

We are driven by technology and push the limits of what can be done to realise the business needs of our customers. Our team is committed towards delivering products of the highest standards and we take pride in creating robust user-driven solutions that meet business needs.

Bitkraft boasts of clients across over 10+ countries including US, UK, UAE, Oman, Australia and India to name a few.

To know more about Bitkraft visit our website bitkraft.co.in

(ref:hirist.tech)

  • Big Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India ARA Resources Full time

    About The Company Ara s Client is a premier IT ITeS Organization for the last 50 years with a pan India footprint They are a pioneer and leader in the Indian ICT industry With more than 4000 employees spread across 100 locations in India They are adding value to every industry through its products services and offerings The Role The Data Engineer will...

  • Senior Big Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Leuwint Technologies Full time

    We are looking for Senior Big Data Engineers to join our team immediately, responsible for designing, developing, maintaining, and implementing large-scale data processing systems for the Sherlock platform. In this role, you will collaborate closely with cross-functional teams, including data scientists, software engineers, business analysts, and product...

  • Big Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Ara Resources Pvt Ltd Full time

    About The Company :Ara's Client is a premier IT &ITeS Organization for the last 50 years with a pan India footprint. They are a pioneer and leader in the Indian ICT industry. With more than 4000 employees spread across 100 locations in India, They are adding value to every industry through its products, services and offerings.The Role :The Data Engineer will...

  • Big Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Ara Resources Pvt Ltd Full time

    About The Company :Ara's Client is a premier IT &ITeS Organization for the last 50 years with a pan India footprint. They are a pioneer and leader in the Indian ICT industry. With more than 4000 employees spread across 100 locations in India, They are adding value to every industry through its products, services and offerings.The Role :The Data Engineer will...

  • Senior Big Data Engineer

    3 days ago

    Mumbai, Maharashtra, India Cloudesign Full time

    Job Overview:At Cloudesign, we are committed to staying at the forefront of innovation in cloud computing. To achieve this goal, we need experienced professionals who can drive our data engineering efforts forward. We are currently seeking a highly skilled Senior Big Data Engineer to join our team. This individual will play a vital role in designing,...

  • Big Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Brainhunter Recruiting Pvt Ltd Full time

    Job Summary:Data Engineer you will work with our big data team to develop quality services, building highly-available and resilient big data platforms, you will be helping teams to rapidly prototype, deliver, and run, high-impact and high-value services.Ideally, you will be someone who has hands-on experience building and optimizing Big Data data pipelines,...

  • Big Data Engineer

    5 days ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Big Data Developer Opportunity We are seeking a top-level Big Data Developer to support our technical consultants in winning application development projects. The ideal candidate will have at least 6+ years of hands-on Big Data development experience, expertise in object-oriented programming, and the ability to interact with other Big Data programmers in a...

  • Senior Big Data Engineer and Architect

    1 day ago

    Mumbai, Maharashtra, India Technospace i Solutions Full time

    We are seeking a highly experienced Senior Big Data Engineer and Architect to join our team at Technospace i Solutions. As a key member of our big data engineering and architecture team, you will be responsible for designing and implementing scalable big data pipelines and architectures to support our data analytics and business intelligence initiatives.The...

  • Big Data Developer

    5 days ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Job Description:We are seeking a highly skilled Data Engineer to support our technical consultants in designing and implementing innovative big data solutions for clients.The ideal candidate will have at least 6+ years of hands-on experience in big data development, expertise in object-oriented programming, and the ability to collaborate with other...

  • Big Data QA

    3 weeks ago

    Mumbai, Maharashtra, India Brainhunter Recruiting Pvt Ltd Full time

    Job Title: Big Data QA Engineer We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software...

  • Big Data QA Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Brainhunter Recruiting Pvt Ltd Full time

    We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verication, PySpark, pipeline monitoring, software testing fundamentals, STLC (Software Testing Life Cycle), MongoDB, and database...

  • Big Data Engineer Lead

    6 days ago

    Mumbai, Maharashtra, India Le Human Resources Solutions pvt ltd Full time

    Job DescriptionWe are seeking an experienced Data Architecture Specialist to lead our data engineering efforts. The successful candidate will have hands-on experience in designing and implementing data pipelines, as well as working with stakeholders to gather requirements and develop automated end-to-end data engineering solutions.Design and implement data...

  • Big Data SME

    2 weeks ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    **Onsite Opportunity- In-Office** Mumbai, India Our company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants' chances of succeeding on projects. We are looking for a senior...

  • Big Data

    4 days ago

    Mumbai, Maharashtra, India Tata Consultancy Services Limited Full time

    Job DescriptionJob DescriptionInvitingApplicationsfor Big data (Pyspark)Job description:Job Title:Big data (Pyspark)Location: MumbaiExperience Range:4-8 yrsJD:- Experience working inSpark, Pyspark, Hive, Hbase, Kafka- Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills.- 2Do impact...

  • Big Data Architect Leader

    4 days ago

    Mumbai, Maharashtra, India Smartavya Analytica Full time

    About the RoleWe are seeking a Senior Hadoop Solutions Architect to lead our Big Data architecture efforts. The ideal candidate will have 12-18 years of experience in Analytics and Big Data, with at least 6 years of experience in a senior role focusing on Hadoop architecture and administration.Key ResponsibilitiesThe Senior Hadoop Solutions Architect will be...

  • DW and Big Data system engineer

    3 weeks ago

    Mumbai, Maharashtra, India Anicalls (Pty) Ltd Full time

    • Cloud Data Analytics (AWS, Oracle, Azure, Snowflake) – Hands-on solution design experience in at least two of cloud platforms. • Experience in growing & mining existing accounts • Experience in implementing at least 4 Cloud Data Analytics & Big Data engagements. • Extensive experience in solution design in complex projects in big data, cloud...

  • Big Data Innovator

    6 days ago

    Mumbai, Maharashtra, India Smartavya Analytica Full time

    Job DescriptionWe are seeking an experienced Hadoop Sr. Developer/Hadoop Lead to join our team at Smartavya Analytica.**Company Overview**: Our company specializes in providing cutting-edge big data solutions to various industries. As a key member of our team, you will be responsible for designing and implementing efficient big data projects using Hadoop,...

  • Senior Big Data Professional

    5 days ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Job Overview:We are seeking a seasoned Big Data Professional to support our technical consultants in designing and implementing cutting-edge big data solutions for clients.The ideal candidate will have extensive experience in big data development, expertise in object-oriented programming, and excellent collaboration skills.Key Responsibilities:Support...

  • Senior Big Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Big Data Pipeline Designer

    2 days ago

    Mumbai, Maharashtra, India Quantiphi Analytics Solutions Private Limited Full time

    **Role & Responsibilities:**We are looking for an experienced Associate Data Architect to join our team and help design and deliver big data pipelines for structured and unstructured data across multiple geographies.**Key Tasks:**Work with cloud engineers and customers to solve big data problems by developing utilities for migration, storage, and processing...