Bigdata, Kafka, Scala, Pyspark

A , Level , Level A , Location , PAN , Scala , KafkaExperience Required3 - 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia

Skill Set : Pyspark / Scala Spark, Python, Azure Databricks and Azure Data FactoryRoles And Responsibilities:- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, SQL.- Optimize SQL queries for efficient data...

SQL knowledge and ability to create semi-complex queries to pull or insert data into Relationship databases - MS SQL , Oracle High-level understanding of Public Cloud offerings like AWS/cloud Working knowledge of Python, including Pandas libraries to work with larger data sets Working knowledge of REST API, JSON Experience with BigData/Hadoop/Spark...

Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

A , Chennai , Level , Level A , Location , Kafka Experience Required 3 - 6 Years Industry Type IT Employment Type Permanent Location India

:Primary Skills: Databricks with Pyspark, PythonSecondaryskills; ADF7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.4+ years of work experience in Databricks, Pyspark and Python project development workExpertise in Bigdata Eco systems like HDFS and SparkStrong hands-on experience...

Company DescriptionJobs for Humanity is dedicated to building an inclusive and just employment ecosystem.Therefore, we have dedicated this job posting to individuals coming from the following communities: Refugee, Neurodivergent, Single Parent, Blind or Low Vision, Deaf of Hard of Hearing Black, Hispanic, Asian, Military Veterans, the Elderly, the LGBTQ, and...

Candidate should have: Thorough understanding of Hadoop, Spark, and ecosystem components. Knowledge of Linux and shell scripting is a must. Sound knowledge on Scala or JAVA. Experience working with a Streaming platform specifically KAFKA Knowledge of AWS and Google Cloud Platform and their various components are preferable. Sound knowledge on Spark, HDFS,...

Hi,Greetings of the dayUrgent Opening for Azure Databricks with Hexaware TechnologiesInterviewF2F on 27th April 24 in Chennai and IndoreRequest you to go through the Job Description thoroughly and if interested, please fill the below mentioned details to process your candidature.1. Total Experience-2. Relevant Experience(Azure...

JobDescription: Weare looking for Data Engineers to join our team. You will usevarious methods to transform raw data into useful data systems. Forexample you ll create algorithms and conduct statistical analysis.Overall you ll strive for efficiency by aligning data systems withbusiness goals. Tosucceed in thisposition you should have strong analytical skills...

We are hiring a Data Engineer, and we are looking for someone to join our team. Check out the job details below:Design, develop, and maintain data processing pipelines using Apache Spark and ScalaOptimize Spark jobs for performance, scalability, and reliabilityCollaborate with data engineers and data scientists to implement data-driven solutionsDevelop and...

Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...

It's fun to work in a company where people truly BELIEVE in what they are doingThe BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems and...

Full Stack Development background with Java and JavaScript/CSS/HTML Knowledge of ReactJs/Angular is a plus Big Data Engineer with solid background with the larger Hadoop ecosystem and real-time analytics tools including PySpark/Scala-Spark/Hive/Hadoop CLI/MapReduce/Storm/Kafka/Lambda Architecture Comfortable with using the larger Hadoop eco system Familiar...

Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong...

Candidate should have: Excellent interpersonal skills; strong desire to move projects forward and be proactive. Seeks opportunities to learn and improve Strong communication skills and Good knowledge of query optimization and performance tuning. Strong understanding of Bigdata technologies like HIVE, HBASE, HDFS, and any cloud storage like Blob storage or S3...

About the job :- Design, develop, and maintain data processing pipelines using Apache Spark and Scala- Optimize Spark jobs for performance, scalability, and reliability- Work closely with data engineers and data scientists to implement data-driven solutions- Develop and maintain ETL processes to ingest, transform, and load large volumes of data- Perform data...

Role: Big Data Developer Exp: 3-6 Years Location: Chennai, Mumbai, Pune Skills: Bigdata like Hadoop, Hive, Pyspark, Spark, Cloudera

Job Title : Data : Chennai, IndiaImmediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL controlJob Description :We are seeking a highly skilled Data Engineer to join our team in Chennai. The ideal candidate should have strong expertise in Python, PySpark, SQL,...

Spark Scala Data Engineer - Bangalore/ Chennai at Capco India Job Title: Data Engineer with Spark and Scala About Us "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top Best Companies for Women in India by . With our presence...