Big Data Cloud Kafka

Job Description: Design, develop, and maintain scalable data pipelines and systems using DBT and Big Data technologies. Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. Implement data models and transformations using DBT. Develop and maintain ETL processes to ingest and process large...

3+ years experience Responsible to deliver solutioning based on product back log Works with the offshore team and ensures proper delivery of tech and testing aritfacts such as code and design will ensure all coding and testing guidelines are followed Mandatory skills: Java Spring Boot GCP or AWS or Azure Messaging or Kafka Cloud **About...

12+ years of Architecting & Developing Experience working in Big Data Technologies using Apache Hadoop, Spark & SQL etc. 5+ years of strong Development Coding experience using Spark with Python Minimum 3+ Years experience working on Databricks on AWS based Cloud Services 5+ years of strong experience in Big Data design, modelling & Development such as star...

Design, develop, and implement innovative data technology solutions that support the business objectives. A pivotal role in translating business needs into robust and scalable data architectures. Supporting our Chse-wide migration of data and consumers from legacy analytical data platforms to strategic data platforms Guide evaluation of current technology...

Data Modeler (Architect): JD 10+ years of experience in data modeling, database design, or related roles. Experience in relational, dimensional, and/or analytic experience (using RDBMS, dimensional, NoSQL data platform technologies, and ETL and data ingestion protocols). Proven experience in designing data models for ETL/ELT processes and data warehouses in...

They will also need experience working with Google Cloud Platform (GCP) and be able to build and deploy data pipelines on GCP. Experience in big data engineering Strong understanding of Spark. GCP Certified Experience with data modelling and data visualization Excellent problem-solving and analytical skills Strong communication and teamwork...

Job Description: Design, develop, and maintain data pipelines and ETL processes using Databricks. Manage and optimize data solutions on cloud platforms such as Azure and AWS. Implement big data processing workflows using PySpark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective...

Design, develop, and maintain data pipelines and ETL processes using Databricks. Manage and optimize data solutions on cloud platforms such as Azure and AWS. Implement big data processing workflows using PySpark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions. Ensure data...

Job Overview: Key Responsibilities: Perform end-to-end testing for ETL processes using Databricks, ensuring data integrity and accuracy across Snowflake and Postgres databases. Write complex SQL queries for data validation, transformation, and reporting, ensuring that data flows correctly through various systems. Develop and execute automated tests using...

Job descriptionCloud Wizard is seeking passionate engineers eager to implement, migrate and develop solutions using Amazon Web Services (AWS). The ideal candidate will demonstrate enthusiasm for AWS Cloud technology, a dedication to customer success, a commitment to quality, and a genuine enjoyment of their work. As an experienced AWS Cloud Engineer, you...

**Data Architect*** Summary Experience Required: **10 - 15 Years** **Location**: **Bhopal** Category: **Information Technology** Minimum 5+ years of experience as/or Information Architect / Database Architect / Business Intelligence Architect / Data Warehouse Architect / ETL Architect / Analytics Architect / Knowledge Architect / Data Analytics...

At least 3 years of experience in architect role are required along with at least 2 3 years experience designing and building analytics solutions in Azure. Demonstrated experience with Data Migration both onpremises and in the cloud using Azure Native Data Migration Service and other ETL technologies. Demonstrated experience delivering multiple data...

Role: Data ArchitectSkills: GCP Expertise: Proficiency in GCP services such as Big Query, Cloud Dataflow, Cloud Pub/Sub, and Cloud Storage, ETL Processes: Experience with ETL tools and processes for data integration, SQL and NoSQLExperience: 15+ yearsLocation: Greater Noida or BengaluruNotice Period: Immediate to 30 would be preferredA Data Architect with...

Strong Application Development work experience - Agile environment preferred Experience with Junit and Cucumber testing. Hands-on experience in SQL and no SQL database. Hands-on experience in Kafka streaming for events. Experience with APM Monitoring tools and logging tools like Splunk Proficiency with JIRA, Confluence (preferred). Expertise in development...

Lead Software EngineerLocations- Indore, Noida, HyderabadJob DescriptionWe are looking for a Lead Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets.Roles & ResponsibilitiesKey ResponsibilitiesArchitect Data Solutions: Design...

15 years of Architecting & Developing Experience working in Big Data Technologies using Apache, Hadoop, Spark & SQL etc. 5 years of strong Development/ Coding experience using Spark with Python Minimum 3 Years experience working on Databricks on AWS based Cloud Services 5 years of strong experience in Big Data design, modelling & Development such as star...

8+ hands on relevant exp with Java, Scala, Akka and Tableau as mandatory Primarily you will focus on the development, maintenance and testing of new Scala based software over the full software development lifecycle. Specific activities could include: Developing well tested and robust code using Scala in an Agile project environment. Maintain and improve...

Experience bracket: 4-5 YOE ONLYLocation: NoidaNotice Period: Immediate/serving and can join within 15 days.!! DO NOT APPLY IF NOT SERVING NOTICE !!Role Overview:We are seeking a highly motivated and skilled SDET (Software Development Engineer in Test) with 4-5 years of hands-on experience to work closely with our Data Engineering team . In this role,...

**JOB DESCRIPTION** **Skill: PySpark QA** **Role / Tier: Lead Software Engineer/Tier 2** **Experience: 6 - 9 years** Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore, aggregate, transform, store & analyse installing, configuring,...

Should have at-least 10+ years of experience. Should have experience working in MDM (Master Data Management) and Reference 360 data in the last 5 Years. Should have experience using Informatica MDM Cloud - Reference 360 Banking domain expertise to manage the reference data (Ex: Customer 360 or Finance 360) Experience of working in Cloud (GCP is...