Data Architect

2 days ago

Pune, Maharashtra, India beBeeHadoop Full time US$ 1,40,000 - US$ 1,70,000

We are seeking an experienced administrator to manage and optimize our extensive Hadoop platforms, which span thousands of nodes per cluster. This role is crucial for Big Data Administration and Engineering activities across multiple open-source platforms, focusing on improving performance, reliability, and efficiency.

Key Responsibilities:
  • Perform comprehensive Big Data Administration and Engineering activities on multiple open-source platforms, including Hadoop, Kafka, HBase, and Spark.
  • Provide expert-level administration support, with a focus on large-scale clusters.
  • Conduct effective root cause analysis for major production incidents and develop clear learning documentation.
  • Identify and implement high-availability solutions for services with single points of failure to ensure continuous operation.
  • Plan and execute capacity expansions and upgrades in a timely manner to prevent scaling issues and bugs.
  • Automate repetitive tasks to significantly reduce manual effort and prevent human errors, leveraging tools like Ansible, Shell scripting, or Python scripting.
  • Tune alerting mechanisms and set up robust observability to proactively identify issues and performance problems.
  • Collaborate closely with teams to review new use cases and implement hardening techniques, building robust and reliable platforms.
  • Create standard operating procedure (SOP) documents and guidelines for effectively managing and utilizing the Big Data platforms.
  • Leverage DevOps tools and disciplines (Incident, Problem, and Change Management) and standards in day-to-day operations.
Required Skills & Qualifications:
  • 5- 12 years of experience in Big Data Administration and Engineering.
  • Minimum of 2 years of dedicated administration support experience.
  • Strong proficiency in administration automation using tools like Ansible, Shell scripting, or Python scripting.
  • Solid DevOps skills, with the ability to code in at least one language, preferably Python.
  • Hands-on experience with Hadoop, Kafka, HBase, and Spark platforms.
  • Proven strong troubleshooting and debugging skills.
  • Experience in identifying and implementing high-availability solutions.
  • Knowledge of capacity planning, upgrades, and performance tuning for large-scale environments.
  • Familiarity with monitoring, alerting, and observability best practices.

  • 15h Left) Data Architect Consultant

    13 hours ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 293343NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Architect Consultant to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Data Architect...

  • Data Architect

    2 hours ago

    Pune, Maharashtra, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Architect Job OpportunityAre you a skilled professional looking to take your career to the next level? This Data Architect role offers a challenging and rewarding opportunity to utilize your expertise in designing, building, and maintaining large-scale data systems.We are seeking an experienced Data Architect with a strong background in ETL...

  • Data Architect

    3 days ago

    Pune, Maharashtra, India beBeeDataArchitecture Full time ₹ 15,00,000 - ₹ 25,50,000

    Data ArchitectWe are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing, developing, and maintaining data solutions that facilitate data generation, collection, and processing.Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to...

  • Data Architect

    1 day ago

    Pune, Maharashtra, India Calibo Full time US$ 1,50,000 - US$ 2,00,000 per year

    About the Role:We are looking for a highly skilled Data Engineering Architect with strong Data Engineering pipeline implementation experience to serve as the lead Solution/Technical Architect and Subject Matter Expert for customer experience data solutions across multiple data sources. The ideal candidate will collaborate with the Enterprise Architect and...

  • Data Architect

    4 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Solutions ArchitectWe are seeking a highly skilled and experienced Senior Data Solutions Architect to design, build, and maintain robust data pipelines using Azure cloud services.The ideal candidate will have 9-12 years of experience in designing, building, and maintaining scalable data solutions for large-scale organizations.Key...

  • Data Architect

    1 week ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Architect  We are seeking a highly skilled data architect to lead the development of our organization's data management strategy. As a key member of our team, you will be responsible for designing and implementing data warehouses, data marts, and other data management solutions. Develop and implement data architecture designs that meet...

  • Data Architect

    4 days ago

    Pune, Maharashtra, India Artefact Full time

    Job Title: Data Architect Experience Level: 10+ Years Job Overview We are seeking a highly experienced and versatile Data Architect with over 10 years of experience. This role requires deep expertise in data architecture and data engineering, along with exceptional client management and team leadership skills. The ideal candidate will be both strategic and...

  • Data Architect

    1 day ago

    Pune, Maharashtra, India Artefact Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title:Data ArchitectExperience Level:10+ YearsJob OverviewWe are seeking a highly experienced and versatile Data Architect with over 10 years of experience. This role requires deep expertise in data architecture and data engineering, along with exceptional client management and team leadership skills. The ideal candidate will be both strategic and...

  • Data Architect

    17 hours ago

    Pune, Maharashtra, India Artefact Full time

    Job Title: Data ArchitectExperience Level: 10+ YearsJob OverviewWe are seeking a highly experienced and versatile Data Architect with over 10 years of experience. This role requires deep expertise in data architecture and data engineering, along with exceptional client management and team leadership skills. The ideal candidate will be both strategic and...

  • Data Architect

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectData architects design and implement data models to meet business and technical requirements.Collaborate with stakeholders to understand data needs and translate them into effective data structures.Develop and maintain data dictionaries, metadata repositories, and entity-relationship (ER) diagrams.Optimize database structures for...