Big Data Architect

2 days ago

Pune, India Talent Velocity Full time

Job Title : Big Data Architect

Experience : 8+ Years

Location : Nagpur / Pune (Onsite 5 Days Working)

Notice Period : 0 to 30 days max

About the Role :

We are looking for a highly skilled Big Data Architect to design and deliver scalable, production-grade big data solutions integrating Hadoop ecosystems with cloud platforms. The ideal candidate will have hands-on experience in architecting, optimizing, and deploying complex data pipelines while ensuring performance, cost efficiency, and best practices in data engineering.

Key Responsibilities :

- Deliver reference architecture for Hadoop + Cloud integration tailored to enterprise-scale environments.

- Deploy production-grade pipelines using HDFS, Spark, and Kafka for batch and real-time data processing.

- Set up best practices and implement CI/CD frameworks for data engineering workflows.

- Lead data performance optimization and cost-reduction strategies across the big data stack.

- Collaborate with cross-functional teams (data engineers, data scientists, DevOps) to ensure robust, scalable solutions.

- Provide technical leadership and mentor junior engineers in big data technologies.

Required Skills & Qualifications :

- 8+ years of experience in Big Data architecture and engineering.

- Expertise in the Hadoop ecosystem: HDFS, Hive, Sqoop, Oozie, Pig, Impala.

- Strong knowledge of real-time processing frameworks: Kafka, Spark Streaming, Flink.

- Hands-on experience with cloud platforms (AWS, GCP, or Azure) EMR, Dataproc, .HDInsight.

- Proficiency in Python, Scala, or Java for big data solutions.

- Experience with orchestration tools like Airflow or Prefect.

- Familiarity with Lakehouse technologies: Delta Lake, Apache Iceberg.

- Strong understanding of data modeling, data security, and governance best practices.

- Excellent problem-solving, communication, and collaboration skills.

Preferred Qualifications :

- Experience in cost-optimization strategies for large-scale data platforms.

- Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).

- Familiarity with CI/CD tools like Jenkins, GitLab CI/CD.

- Prior experience mentoring and leading engineering teams.


(ref:hirist.tech)

  • Enterprise Big Data Architect

    7 days ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Enterprise Big Data ArchitectJob DescriptionWe are seeking an experienced Enterprise Big Data Architect to lead the design, development and deployment of large-scale big data systems. As a key member of our team, you will be responsible for architecting and implementing scalable, secure and high-performance big data solutions using Hadoop, Spark,...

  • Big Data Architect

    4 days ago

    Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time

    **Position**: Big Data Architect **Education**: Bachelor’s / Master’s degree in computer science, computer engineering, or relevant field. **Experience**: 10-12 Years **Skills Requirement**: - Overall 10+ years of experience, at least 2 years of experience in Big Data Architect. - Strong understanding of big data technologies: Hadoop, Spark, NoSQL...

  • Big Data Architect

    2 weeks ago

    Kothrud, Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time

    Position - Big Data Architect Experience: 10-12 years Key Responsibilities: - Data Architecture Design: Designing and implementing scalable and resilient data architectures for both batch and streaming data processing. - Data Modeling: Developing data models and database structures to ensure efficient data storage and retrieval. - Data Security and...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeBigDataEngineer Full time US$ 1,20,000 - US$ 1,75,000

    Senior Big Data EngineerAs a seasoned Big Data Engineer, you will be responsible for architecting and building large-scale data pipelines using Apache Spark and Databricks.Key Responsibilities:Design and implement complex data pipelines to process and analyze large datasets.Develop expertise with streaming systems such as Apache Kafka and Confluent...

  • Senior Big Data Architect

    4 days ago

    Pune, India Mycitypune Full time

    Job Description - Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field - Experience: 3-5 years of hands on experience across Big Data project implementations. - Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key...

  • Big Data Solutions Architect

    1 week ago

    Pune, Maharashtra, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,60,000

    The role of a Big Data Solutions Architect is to design and build scalable data pipelines using Python and PySpark. This involves collaborating closely with business stakeholders, solution architects, and data analysts to deliver efficient, scalable, and high-quality data solutions.Key ResponsibilitiesDesign and build ETL pipelines using Python and...

  • Senior Big Data Architect

    6 days ago

    Pune, Maharashtra, India Mycitypune Full time

    Job Description- Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field- Experience: 3-5 years of hands on experience across Big Data project implementations.- Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key stakeholders...

  • Big Data Infrastructure Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 19,09,025 - ₹ 25,95,450

    Job Title: Big Data Infrastructure ArchitectWe are seeking an experienced Big Data Infrastructure Architect to join our team. This is a key role for designing and implementing large-scale data processing systems, collaborating with cross-functional teams, and delivering data solutions.Responsibilities:Lead data engineering teams to design and implement...

  • Gdc Big Data Architect

    2 weeks ago

    Pune, India Cranium IT Inc Full time

    skill: Exp: 10+ years Joining: immediate to max 30 days JD: design of SDP data platform, - 8+ years of experience - Hands-on experience in Big Data (Cloudera - Hadoop, Spark, etc.) - Hands-on experience in stream processing (RT/NRT) - Apache Kafka, NiFi and similar - Strong background in developing and utilizing tools that prepare, extract and manipulate...

  • Big Data Architect

    4 days ago

    Pune, India Consulting Pandits Full time

    Big Data Architect - Build the Future of Data ManagementAre you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of...