Big Data, Pyspark, GCP

4 weeks ago

Hyderabad, Telangana, India HSBC Full time
Job Description

Job description

Some careers shine brighter than others.

If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist.

In this role, you will be:

- At least 8 years of experience in Big Data, Pyspark, GCP , Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines.
- Possess the following technical skills - SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar)
- Skills and experience to support the upgrade from Hadoop to Cloudera.
- Good knowledge of Industry Best Practice for ETL Design, Principles, Concepts.
- Data Extraction from Teradata, HIVE, Oracle, and Flat files
- Ability to work independently on specialized assignments within the context of project deliverables
- Take ownership of providing solutions and tools that iteratively increase engineering efficiencies.
- Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Data Pipelines
- Proven problem solving and analytical abilities including the ability to critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details and apply sound business and technical domain knowledge
- Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills - the ability to communicate efficiently at a global level is paramount.
- Ability to deliver materials of the highest quality to management against tight deadlines.
- Ability to work effectively under pressure with competing and rapidly changing priorities.
- Responsible for automating the continuous integration/continuous delivery pipeline within a DevOps Product/Service team driving a culture of continuous improvement
- Keep up-to-date and have expertise on current tools, technologies and areas like cyber security and regulations pertaining to aspects like data privacy, consent, data residency etc. that are applicable.

.

Requirements

To be successful in this role, you should meet the following requirements:

- 8+ Years of IT Experience. Working knowledge on leading Regulatory projects. Possess in-depth knowledge and understanding of technical concepts, systems, and processes relevant to the organization. Strong working knowledge on Pyspark, GCP, Dataproc, Airflow.
- Hands-on experience in Python, Spark, Hive, SQL, GCP and Hadoop technologies
- Good to have exposure in Cloudera Data Platform (CDP), Big Data, Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines.
- Skills and experience to support the upgrade from Hadoop to Cloudera. Good knowledge of Industry Best Practice for ETL Design, Principles, Concepts. Data Extraction from Teradata, HIVE, Oracle, and Flat files. Experience in handling/Conducting scrum ceremonies and practice Agile best practices.
- Working knowledge on DevOps best practices and building CI/CD pipelines with end-to-end automation. Ability to work independently on specialized assignments within the context of project deliverables .

You'll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by - HSBC Software Development India

  • Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Synechron Full time

    About Us">At Synechron, we combine creativity with innovative technology to deliver digital solutions. Our global consulting firm spans industry-leading digital services, including Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering. We service a range of financial services and technology firms through our FinLabs...

  • Big Data Engineer

    5 days ago

    Hyderabad, Telangana, India Synechron Full time

    About the Opportunity:Synechron is a global consulting firm that leverages digital technology to transform businesses. We deliver industry-leading digital solutions through innovative technologies, optimization strategies, and research initiatives.Job Description:The successful candidate will work on designing and developing scalable PySpark applications...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Synechron Full time

    Welcome to Synechron:We are a global consulting firm that helps businesses transform through digital innovation.As a PySpark Developer, you will play a key role in designing and developing scalable data pipelines using PySpark and GCP.You will analyze and process large datasets using SQL and Big Data technologies, and work closely with cross-functional teams...

  • Cloud-based Data Scientist

    2 days ago

    Hyderabad, Telangana, India Synechron Full time

    Synechron Job Description:Job Title: PySpark Developer (GCP + PySpark)Location: HyderabadNotice Period: 0-15 daysAbout the Role:We are seeking a skilled PySpark Developer with 5-8 years of experience in GCP and PySpark to join our team in Hyderabad.The ideal candidate will have strong skills in SQL, Big Data technologies, and Shell scripting, and will be...

  • GCP Big Data Specialist

    1 week ago

    Hyderabad, Telangana, India RandomTrees Full time

    About Us:RandTrees is a cutting-edge software company that utilizes innovative technologies like AI, ML, and Data Analytics to create impactful solutions. We're passionate about empowering our team members to drive innovation and make a lasting impact.Job Summary:We're looking for an accomplished GCP Data Engineer who can craft, implement, and refine complex...

  • Gcp Data Engineer

    1 day ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title : GCP Data Engineer Job Location – Gurgaon / Chennai / Hyderabad / Bangalore / Pune Experience: 5 to 8 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions.Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of Big Data and Hadoop Ecosystems.Strong...

  • Big Data Expert with PySpark and BigQuery

    3 days ago

    Hyderabad, Telangana, India Nagarro Software Pvt. Ltd Full time

    Job DescriptionWe're seeking a skilled Senior Big Data Engineer to join our team. The ideal candidate will have experience in building and optimizing ETL pipelines using PySpark and BigQuery.The successful candidate will be responsible for designing scalable data systems, orchestrating workflows using Cloud Composer, and working with large-scale data...

  • GCP Data Engineer

    3 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Gurgaon / Chennai / Hyderabad / Bangalore / PuneExperience: 5 to 8 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions.GCP Data Engineer - GCP,Terradata, Python , Big query, Data flow, Cloud Composer, SQL,Groovy, Requirement:Mandatory to have knowledge of Big Data...

  • GCP Data Engineer

    1 week ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Gurgaon / Chennai / Hyderabad / Bangalore / PuneExperience: 5 to 8 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions.Requirement:Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems.Strong experience...

  • GCP Data Engineer

    5 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title : GCP Data Engineer Job Location – Gurgaon / Chennai / Hyderabad / Bangalore / Pune Experience: 5 to 8 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems....

  • GCP Data Architect

    4 weeks ago

    Hyderabad, Telangana, India LTIMindtree Full time

    Total Expereince: 12+ yearsPrimary Skills- GCP, PysparkLocation- Bangalore & PuneMinimum 10 years of work experience specifically in defining solution application design and development integration migration Should have at least 5 year of experience in GCP Google Cloud Platform or Similar Cloud Technologies Understanding of Google Cloud Platform GCP...

  • PySpark Developer

    5 days ago

    Hyderabad, Telangana, India Synechron Full time

    About the Role:The successful candidate will work on developing and implementing scalable data solutions using PySpark applications on Google Cloud Platform (GCP). Key responsibilities include:Designing and developing efficient PySpark applications using Airflow and DataProcWriting SQL queries to optimize data processingCollaborating with cross-functional...

  • PySpark Developer

    2 weeks ago

    Hyderabad, Telangana, India Synechron Full time

    Hello Everyone,PySpark Developer (PySpark + GCP),Experience - 5 to 8 yearsLocation - HyderabadNotice - 0 - 15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive...

  • PySpark Developer

    2 weeks ago

    Hyderabad, Telangana, India Synechron Full time

    Hello Everyone,PySpark Developer (PySpark + GCP),Experience - 5 to 8 yearsLocation - HyderabadNotice - 0 - 15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive...

  • PySpark Developer

    5 days ago

    Hyderabad, Telangana, India Synechron Full time

    Hello Everyone,PySpark Developer (PySpark + GCP),Experience - 5 to 8 yearsLocation - HyderabadNotice - 0 - 15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive...

  • PySpark Developer

    3 days ago

    Hyderabad, Telangana, India Synechron Full time

    Hello Everyone,PySpark Developer (PySpark + GCP),Experience - 5 to 8 yearsLocation - HyderabadNotice - 0 - 15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive...

  • PySpark Specialist on Google Cloud Platform

    2 weeks ago

    Hyderabad, Telangana, India Synechron Full time

    About Us">Synechron is a global consulting firm that combines creativity with innovative technology to deliver digital solutions. Our services span industry-leading digital services, including Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering.">Our Culture">We strive to create an inclusive culture that promotes...

  • Big Data Engineer, Data Modeling

    4 days ago

    Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Cloud-Based PySpark Engineer

    2 weeks ago

    Hyderabad, Telangana, India Synechron Full time

    Company Overview">Synechron is a global consulting firm that combines creativity with innovative technology to deliver digital solutions. Our services span Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, serving a range of financial services and technology firms.">Job Description">We are seeking a skilled PySpark...

  • Big Data Architect

    2 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    About Us">Anblicks is a leading technology consulting firm that helps organizations leverage data and analytics to drive business outcomes. We are looking for talented professionals who share our passion for innovation and excellence.Required Skills & Experience">Must-Have: 5+ years of experience in data engineering with exposure to big data and ETL:...