Data Architect for Large Scale Data Processing

1 week ago


Ahmedabad, Gujarat, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time
About the Role

We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery.

This role requires excellent data analysis skills and the ability to architect solutions for cloud-based environments, with a focus on extracting, processing, and analyzing data from diverse sources. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics.

Key Responsibilities:
  • Design, develop, and optimize Big Data pipelines and workflows using Hadoop, Hive, PySpark, and Google BigQuery.
  • Architect data solutions to facilitate smooth data migration and processing between on-premises systems and Google Cloud Platform (GCP).
  • Create and manage Unix Shell Scripts for process automation and data handling tasks.
  • Perform in-depth data analysis and work comfortably with large datasets to derive actionable insights.
  • Collaborate effectively with cross-functional teams to understand data requirements and translate them into scalable data solutions.
  • Ensure data quality, integrity, and security across all stages of the data lifecycle.
  • Stay updated with the latest industry trends and emerging technologies to continuously improve data solutions.

Mandatory Qualifications:
  • Minimum of 8 years of industry experience working with Big Data technologies.
  • Proficiency in Hadoop, Hive, and PySpark for data processing.
  • Strong experience with Unix Shell Scripting.
  • Expertise in SQL and extracting data from multiple sources.
  • Demonstrated experience in data analysis, specifically querying and analyzing large datasets on Hadoop HDFS using Hive and Spark.
  • Proven experience in architecting Big Data pipelines and data solutions.
  • Proficiency in Google BigQuery and migrating data pipelines to GCP.
  • Exceptional communication skills for clear requirement gathering and collaboration.

Preferred Qualifications:
  • Google Cloud Platform (GCP) certification.
  • Professional experience with cloud hosting platforms, with a preference for GCP.

The estimated salary for this role is $150,000 - $200,000 per year, depending on location and experience.



  • Ahmedabad, Gujarat, India Infraveo Full time

    Infraveo is seeking a highly skilled Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing, implementing, and maintaining robust data infrastructure solutions and complex ETL processes that drive our core business operations.Responsibilities:Design and Implementation of Scalable Data Solutions: You will be...


  • Ahmedabad, Gujarat, India KH INDIA GCC PRIVATE LIMITED Full time

    Job OverviewKH India GCC Private Limited is seeking a highly skilled and experienced Automation Expert to join our team. This is an exciting opportunity to work on large-scale process automation projects using Automation Anywhere 360 RPA platform.About the RoleThe successful candidate will be responsible for developing, implementing, and maintaining existing...

  • Data Architect Lead

    1 week ago


    Ahmedabad, Gujarat, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    AEXONIC TECHNOLOGIES PRIVATE LIMITED seeks a seasoned Senior Big Data Engineer to lead the design and development of robust data pipelines on Google Cloud Platform (GCP). This critical role requires expertise in Hadoop, Hive, PySpark, and BigQuery.About the RoleThe ideal candidate will be responsible for architecting scalable data solutions, ensuring data...


  • Ahmedabad, Gujarat, India Azilen Technologiues Full time

    Job OverviewAzilen Technologies is seeking a skilled Senior Software Developer to design and implement cutting-edge technical solutions using the latest technologies and tools.Estimated Salary: ₹20,00,000 - ₹25,00,000 per annumJob DescriptionWe are looking for a talented developer who can take ownership of requirement gathering, development, and...


  • Ahmedabad, Gujarat, India Welspun Transformation Services Limited Full time

    About the RoleWe are seeking an experienced Chief Data Architect to lead our data engineering team at Welspun Transformation Services Limited.As a key member of our IT department, you will be responsible for designing and building high-performance data infrastructure, ensuring robustness and scalability in our data management systems.The ideal candidate will...


  • Ahmedabad, Gujarat, India Infraveo Full time

    Mortgage Data Engineer JobWe are seeking an experienced Data Engineer to join our team at Infraveo. This is a remote position.Main Responsibilities:Design and Develop Scalable Data Pipelines: Create efficient ETL pipelines that extract, transform, and load mortgage-related data from various sources into scalable data stores.Collaborate with Domain Experts:...


  • Ahmedabad, Gujarat, India Azilen Technologiues Full time

    Job OverviewAzilen Technologies is seeking a highly skilled software engineer to design and implement cutting-edge technical solutions using the latest technologies and tools.About the RoleThis is a full-time opportunity based in our Ahmedabad office. The ideal candidate will have at least 4 years of experience in software development.Key...

  • Sales Director

    5 days ago


    Ahmedabad, Gujarat, India Walplast Products Pvt. Ltd. Full time

    About the RoleAt Walplast Products Pvt Ltd, you will be responsible for driving sales through large-scale projects within your designated area. This entails developing and implementing project-specific sales strategies, managing a team of sales officers, and collaborating closely with key stakeholders such as builders, contractors, applicators, and...


  • Ahmedabad, Gujarat, India Crest Data Full time

    About Crest DataWe are a global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. Our clientele includes several Fortune 500 corporations and innovative Silicon Valley Startups.Job Title: Chief Software ArchitectLocation: AhmedabadAbout the RoleAs a key member...


  • Ahmedabad, Gujarat, India Crest Data Full time

    Job DescriptionWe are seeking an experienced Principal Software Architect to lead our technology team at Crest Data.Company OverviewCrest Data is a global leader in data analytics, security, and cloud solutions. We work with Fortune 500 corporations and innovative startups, providing cutting-edge technological services.Our company is headquartered in...


  • Ahmedabad, Gujarat, India Eminence Full time

    About EminenceEminence is a leading organization that thrives on innovation and excellence. Our team of experts is dedicated to delivering top-notch solutions that cater to the ever-evolving needs of our clients.Job Summary:We are seeking a highly skilled Senior Data Architect to join our team. As a key member, you will be responsible for designing and...


  • Ahmedabad, Gujarat, India Crest Data Full time

    About Crest DataAs a leading provider of data center solutions and engineering/marketing services, Crest Data has extensive experience in building and deploying various Data Center products from renowned global enterprises. Our team excels in delivering cutting-edge solutions for Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big...


  • Ahmedabad, Gujarat, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Senior Big Data Engineer Job DescriptionAbout AEXONIC TECHNOLOGIES PRIVATE LIMITEDAEXONIC TECHNOLOGIES PRIVATE LIMITED is seeking a highly skilled Senior Big Data Engineer to join our team. As a Senior Big Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines that support large-scale data processing and...

  • Technical Lead

    2 weeks ago


    Ahmedabad, Gujarat, India Crest Data Full time

    Crest Data, a global leader in providing Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services, seeks an experienced Technical Lead to join our team.Job DescriptionWe are looking for a skilled Technical Lead with expertise in software development life cycle, architecture, design,...


  • Ahmedabad, Gujarat, India Crest Data Full time

    We are seeking a skilled Senior Software Engineer to lead the development of Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments at Crest Data.Key Responsibilities:Provide expertise in software development life cycle, from concept, architecture, design, implementation, & testing.Lead and mentor mid-sized teams.Ensure...


  • Ahmedabad, Gujarat, India Crest Data Full time

    About Crest DataCrest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Job DescriptionWe are seeking an experienced Senior...


  • Ahmedabad, Gujarat, India Alliance Recruitment Agency Full time

    Are you a seasoned HR professional with a passion for strategic leadership? Do you have experience in managing large-scale manufacturing facilities and teams?About the RoleWe are seeking a highly skilled Chief Human Resources Officer to join our client, a leading Foreign MNC based in Amman, Jordan. As a key member of the senior leadership team, you will be...


  • Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Anblicks Cloud Data Engg Private Limited in Hyderabad or Ahmedabad. The ideal candidate will have strong knowledge of Python and SQL, with a clear understanding of data warehouse fundamentals, data modeling, and ELT/ETL processes. Job DescriptionAs a Senior Data Engineer, you...


  • Ahmedabad, Gujarat, India Crest Data Full time

    Senior Software Engineer/Technical Lead OpportunityCrest Data Systems is seeking a highly skilled Senior Software Engineer/Technical Lead to join our team in Ahmedabad, Gujarat. This role offers a unique chance to work on cutting-edge data center solutions and contribute to the company's growth.About Us:Crest Data is a leading provider of engineering...

  • Data Architect

    1 week ago


    Ahmedabad, Gujarat, India Aviin Tech Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Aviin Tech. This is an excellent opportunity for a motivated and experienced professional to take on a challenging role in designing, developing, and maintaining our data architecture and infrastructure.Key ResponsibilitiesDesign and implement efficient data pipelines and ETL...