Big Data Engineer

Job Description : - Azure data Engineer - Azure Data Factory - azure databricks- python - sql- Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database- Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.- Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.- Some experience...

Requirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write unit tests...

Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...

Required Qualifications :- 7-8 years of experience as a Data Engineer or in a similar role- Proficient in Python programming and PySpark for data processing and transformation- Extensive experience in designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow)- Strong SQL skills, including experience with AWS Redshift- Familiarity with...

Key Responsibilities :Data Pipeline Development :- Design, develop, and maintain scalable data pipelines using Big Data technologies (e.g., Apache Hadoop, Apache Spark, Kafka).- Implement data ingestion strategies to efficiently load and transform large datasets from various sources.Data Architecture and Modeling :- Collaborate with data architects to design...

Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

We have Immediate openings on Apache developerJob description : - Data Pipeline Development : Design, develop, and maintain data processing pipelines using Apache Spark and Scala, ensuring high performance and scalability.- Data Transformation and Analysis : Implement complex data transformations, aggregations, and analytics using Spark, optimizing for...

Big Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scriptingRoles & Responsibilities :- Responsible for designing and implementing data...

Job Description :Responsibilities :1. Explain and communicate the design / development to the customer2. Perform and evaluate test results against product specifications3. Break down complex problems into logical components4. Develop user interfaces business software components5. Use data models6. Estimate time and effort required for developing / debugging...

Key Responsibilities :- Design, develop, and optimize Big Data pipelines and workflows using Hadoop, Hive, PySpark, and Google BigQuery.- Architect data solutions to facilitate smooth data migration and processing between on-premises systems and Google Cloud Platform (GCP).- Create and manage Unix Shell Scripts for process automation and data handling...

Role : Data Engineer - Spark/Scala. Job Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark, HBase, Hive and...

Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

Job Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...

Data Engineer (Python & SQL)Position : Data Engineer (Python & SQL)Locations : Hyderabad, Chennai, Bengaluru, Mumbai, Pune, Kolkata, GurugramJob Type : Full-TimeCompany : Reputed Big 4 MNC client company of Live Connections.Role Overview :We are looking for a skilled Data Engineer with experience in Python, SQL, and Financial Services Industry (FSI) to join...

Job Designation : ETL DeveloperWFH / WFOJob Description :- Work Experience : Overall 3+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience.Role & Responsibilities :- To be a Data expert/Architect in implementing solutions using Databases/ETL/DWH/Data Integration/Reporting tools with...

Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...

Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...

Data Engineer (Cloud & Ontologies)Job Description : Excelra is hiring for experienced Data Engineer with expertise in ontologies, AWS, Azure, and various data technologies. The role involves building and maintaining scalable data pipelines, working with cloud platforms, and supporting server and application deployment.Roles and Responsibilities : - Cloud...

Job Description :Essential Technical Skills :- Technical expertise with emerging Big Data technologies, such as : Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualization tools : Tableau and PowerBI- Experience with cloud, container and micro service infrastructures- Experience working with divergent data sets that meet the requirements of...

Job Description :We are looking for candidates who can join immediately. InnotatzIT Solutions is a global Software Development, IT Product Design and IT Consulting Company predominantly focused on Web Application Development, Digital Innovations & IT Recruitment Solutions. We also provide global digital consultancy that helps brands leverage design,...