Chief Big Data Infrastructure Architect

1 month ago

India Mastek Full time

Job Title: Chief Big Data Infrastructure Architect

About the Role:

We are seeking an experienced Senior Cloudera Data Engineer to join our team at Mastek. As a key member of our data engineering team, you will design, develop, and maintain large-scale data pipelines and infrastructure on the Cloudera platform.

About You:

To be successful in this role, you should have a strong background in data engineering, hands-on experience with Cloudera tools, and a deep understanding of big data architectures. You should also be proficient in programming languages such as Python, Java, or Scala, and have a solid understanding of data modeling, data warehousing concepts, and big data architectures.

Key Responsibilities:

  • Design and Develop Data Pipelines: Design, develop, and maintain scalable and robust data pipelines and ETL processes using Cloudera tools and frameworks (e.g., HDFS, Hive, Impala, HBase, Spark, Flink).
  • Implement Complex ETL Processes: Design, development, and implementation of complex ETL processes using Informatica PowerCenter.
  • Data Integration and Management: Utilize Informatica DEI for integrating, transforming, and managing large volumes of data across various data platforms, including Hadoop, Spark, and other big data technologies.
  • Collaboration and Communication: Collaborate with data architects, data scientists, and business stakeholders to understand requirements and deliver solutions that meet their needs.
  • Performance Optimization: Optimize and tune performance of data processing jobs, ensuring efficient resource usage and fast execution times.
  • Data Governance: Implement and enforce best practices for data integration, data quality, data security, and governance.
  • Troubleshooting and Resolution: Monitor, troubleshoot, and resolve data pipeline and infrastructure issues promptly, ensuring high availability and reliability.
  • Documentation and Knowledge Sharing: Develop and maintain documentation related to data pipelines, processes, and infrastructure.
  • Staying Up-to-Date: Stay up to date with the latest industry trends, technologies, and best practices in big data and cloud computing.
  • Mentorship and Guidance: Provide technical guidance and mentorship to junior data engineers within the team.

Requirements:

  • Education: Bachelor's or master's degree in computer science, Information Technology, Data Science, or a related field.
  • Experience: 8-9 years of professional experience in data engineering, with a significant focus on Cloudera platforms.
  • Skills: Strong experience of working on support engagements for Cloudera data platform; Strong hands-on experience with Cloudera tools and technologies such as Hadoop, Hive, Impala, HBase, Spark, Flink, and Kafka; Experience in Design, development, and implementation of complex ETL processes using Informatica PowerCenter; Experience in Utilizing Informatica DEI for integrating, transforming, and managing large volumes of data across various data platforms, including Hadoop, Spark, and other big data technologies; Proficiency in programming languages such as Python, Java, or Scala; Solid understanding of data modeling, data warehousing concepts, and big data architectures; Experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization (e.g., Docker, Kubernetes) is a plus.

Benefits:

  • Competitive Salary: We offer a competitive salary ranging from $150,000 to $200,000 per year, depending on experience.
  • Health Insurance: Comprehensive health, dental, and vision insurance.
  • Retirement Plan: Retirement savings plan with company match.
  • Professional Development: Professional development opportunities and educational reimbursement.
  • Flexible Work Hours: Flexible work hours and remote work options.
  • Inclusive Work Environment: Inclusive and collaborative work environment.

  • Big Data Solutions Architect

    2 weeks ago

    India ITI Data Full time

    Job Title: Big Data Solutions Architect Company Overview:ITI Data is a leading provider of data solutions and services. About the Role:We are seeking an experienced Big Data Solutions Architect to join our team. The successful candidate will have a strong background in designing and implementing large-scale data architectures using Apache Spark, Hadoop, and...

  • Big Data Architect

    2 days ago

    India Bloom Consulting Services Full time

    **Big Data Architect ( Job ID : 000000800 )**: NA Experience **12 - 16 years** Offered Salary Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses...

  • Big Data Architect

    2 weeks ago

    India Bloom Consulting Services Full time

    NA Experience **12 - 16 years** Offered Salary Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end tools). 9+ years of...

  • Big Data Architect

    2 weeks ago

    India Bloom Consulting Services Full time

    Not Disclosed Experience **12 - 16 Years** Offered Salary **Lakh** Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end...

  • Chief Data Solutions Architect

    3 days ago

    India Giant Eagle GCC Full time

    Job OverviewWe are seeking an experienced Chief Data Solutions Architect to join our Enterprise Data Platform team. As a key member of the team, you will be responsible for architecting and implementing scalable data pipelines, data lakes, and robust data platforms using advanced big data tools on Azure.About the RoleThe ideal candidate will have extensive...

  • Big data solutions architect

    1 month ago

    India BluCognition Full time

    About blu Cognition : blu Cognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune. Our clients are some of the biggest and the most progressive names in the financial &...

  • Chief Data Architect

    1 month ago

    India Eximietas Design Full time

    About Eximietas DesignWe are a leading provider of innovative solutions in the field of data engineering. Our team is passionate about designing, building, and maintaining robust data pipelines that drive business growth.Job OverviewThis is an exciting opportunity for a skilled Chief Data Architect to join our team in Bengaluru. The ideal candidate will have...

  • Big Data Solutions Architect Lead

    1 week ago

    India bluCognition Full time

    About bluCognitionWe are an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. Our headquarters is located in the US, with a delivery centre in Pune.We have some of the biggest and most progressive names in the financial & telecom industry as our clients....

  • Data Infrastructure Architect

    4 weeks ago

    India Aiverbalyze Technologies Private Limited Full time

    About Aiverbalyze Technologies Private LimitedAiverbalyze Technologies Private Limited is a fast-growing tech company specializing in AI-driven solutions. Our mission is to revolutionize the way businesses interact with their customers.Estimated Salary: ₹1200000 - ₹1500000 per annumJob Description:We are seeking an experienced Data Infrastructure...

  • Big Data Infrastructure Solutions Architect

    4 days ago

    India Iridium Cloud Systems Pvt Ltd Full time

    At Iridium Cloud Systems Pvt Ltd, we revolutionize the Internet by creating an open and quality platform where anyone can thrive.We craft our own architecture and services to ensure unparalleled satisfaction for our customers. As a pioneering company in the hosting, domain, and DNS space, we're seeking a highly skilled Senior Big Data and Container...

  • Big Data Architect

    2 weeks ago

    India leading MNC Full time

    Job Overview:We are seeking an experienced Big Data Architect to join our team at a leading MNC. As a key member of our data engineering team, you will design and implement scalable and efficient data processing systems using cloud-native technologies.Responsibilities:Design and develop distributed data lake query engines with high scalability and low...

  • Big Data Solutions Architect

    7 days ago

    India bluCognition Full time

    About bluCognition : bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune. Our clients are some of the biggest and the most progressive names in the financial & telecom...

  • Big Data Solutions Architect

    1 week ago

    India bluCognition Full time

    About bluCognition :bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune.Our clients are some of the biggest and the most progressive names in the financial & telecom...

  • Chief Data Architect

    1 month ago

    India IGT Solutions Full time

    We are seeking an experienced Chief Data Architect to join our team as an AI Strategist.This is a permanent, full-time position with a competitive salary of $150,000 - $200,000 per year.About the Role: The successful candidate will be responsible for designing and architecting scalable and robust IT solutions that align with client requirements and business...

  • Chief Data Architect for AI Innovations

    2 weeks ago

    India Waii Full time

    We are seeking a talented Chief Data Architect to join our team at Waii, a cutting-edge company revolutionizing the way businesses derive value from data. As a founding member of our engineering team, you will play a crucial role in designing and implementing the interface between human and state-of-the-art AI & data technologies.This is an exceptional...

  • Big data infrastructure engineer

    18 hours ago

    India Iridium Cloud Systems Pvt Ltd Full time

    Join Iridium Cloud Systems and Revolutionize the Internet Iridium Cloud Systems subsidiary of cdmon.com, your go-to hosting, domain, and DNS company. Our mission is straightforward yet ambitious: To create an open and quality Internet where anyone can be. We're proud to craft our own architecture and services, ensuring unparalleled satisfaction for our...

  • Chief Data Security Architect

    4 weeks ago

    Anywhere in India/Multiple Locations Paramount Computer Systems Full time

    Job DescriptionParamount Computer Systems seeks a highly skilled Chief Data Security Architect to lead the design, implementation, and maintenance of data privacy and security policies, procedures, and controls.About UsWe are a dynamic company dedicated to ensuring the integrity and security of our IT infrastructure. Our team is passionate about delivering...

  • Chief Architect of Data Infrastructure

    1 month ago

    India LinkedIn Full time

    About the RoleWe are looking for a passionate and entrepreneurial engineering leader to join our Bangalore engineering team. In this role, you will lead our global charter around Data In Motion, as part of the LinkedIn Data Infrastructure team.

  • Chief Data Infrastructure Architect

    1 day ago

    India HiPaaS Inc. Full time

    OverviewHiPaaS Inc. is a leading provider of cutting-edge data infrastructure solutions.

  • Big Data Solution Architect

    2 weeks ago

    India EPAM Systems Full time

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...