Engineer (Spark, SparkSQL)

Requirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...

Candidate should be able to:Coordinate Development, Integration, and Production deployments.Optimize Spark code, Impala queries, and Hive partitioning strategy for better scalability, reliability, and performance.Build applications using Maven, SBT and integrated with continuous integration servers like Jenkins to build jobs.Execute Hadoop ecosystem and...

Must Have/Good to Have : - Strong experience in Microsoft Azure and Experience with big data tools : Hadoop, Spark, Kafka, etc.- Experience with object-oriented/object function scripting languages Python, Java, C++, Scala, etc.- Experience in ETL tools including Azure Data Factory- Experience in Azure Data Lake, Azure SQL, Azure Synapse.- Strong SQL, Data...

Job Description :Skills : Python , Pyspark, Azure data bricks, data factor, data lake, SQL.- Deep knowledge and experience working with Python/Scala and Spark- Experienced in Azure data factory, Azure Data bricks, Azure Data Lake, Blob Storage, Delta Lake, Airflow.- Experience working with SQL and NoSQL database systems such as MongoDB, Apache Parquet-...

Job Description : Skills : Python , Pyspark, Azure data bricks, data factor, data lake, SQL.- Deep knowledge and experience working with Python/Scala and Spark- Experienced in Azure data factory, Azure Data bricks, Azure Data Lake, Blob Storage, Delta Lake, Airflow.- Experience working with SQL and NoSQL database systems such as MongoDB, Apache Parquet-...

Job Title : Databricks AdminExperience : 4+yrLocation : RemoteBudget : 12-15 lpaEducation : AnyPrimary skills : Databricks Administrator, Apache Spark, Databricks architecture, cloud platforms, such as AWS, Azure, or Google CloudRequirements :- Proven experience as a Databricks Administrator or in a similar role.- Strong knowledge of Apache Spark and...

Requirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...

Requirements : Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture. Extensive experience in data modeling and database design. At least 6+ years of hands-on experience in Spark/Bigdata Tech stack. Stream processing engines - Spark Structured Streaming/Flink. Analytical processing on...

Candidate should be able to:Analyze, design, program, debug, and modify software enhancements and/or new products used in local, networked, or Internet-related computer programs, primarily for end-usersWrite code and complete programming by using current programming languages and technologiesInteract with users to define system requirements and/or necessary...

Who we areBrightly, a Siemens company, is the global leader in intelligent asset management solutions. Brightly enables organizations to transform the performance of their assets with a sophisticated cloud-based platform that leverages more than 20 years of data to deliver predictive insights that help users through the key phases of the entire asset...

Who we areBrightly, a Siemens company, is the global leader in intelligent asset management solutions. Brightly enables organizations to transform the performance of their assets with a sophisticated cloud-based platform that leverages more than 20 years of data to deliver predictive insights that help users through the key phases of the entire asset...

Data Quality Analyst/RulesEngineerJob DescriptionSummaryThe DQ Analyst is responsible forperforming analysis data profiling and the writing of businessrules for PayPal s critical data elements to help ensure that thedata used for reporting and analysis is accurate and reliable .Theywill partner with our Data Management and Data Engineering Teams toperform...

Job Description Position: Lead Data Engineer Location: Greater Noida Duration: Full Time MUST HAVE SKILLS: 1: Azure Cloud 2: DataBricks 3: DBT 4: Datawarehouse Concepts JOB DESCRIPTION: 6- 8+ year experience with Data Engineering, Data Pipelines and SQL Concepts. Strong hands-on experience with DBT. ...

Requirement :- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java).- Solid Data warehousing concepts.- Knowledge of Financial reporting ecosystem will be a plus.- 4+ years of experience within Data Engineering/ Data...

Location : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.- Demonstrated track record of effectively optimizing performance.- Adept at leveraging...

Location : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum. Job Description : - Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.- Demonstrated track record of effectively optimizing performance.- Adept at...

Job Description Position: Lead Data Engineer Location: Greater Noida Duration: Full Time MUST HAVE SKILLS: 1: Azure Cloud 2: DataBricks 3: DBT 4: Datawarehouse Concepts JOB DESCRIPTION: 6- 8+ year experience with Data Engineering, Data Pipelines and SQL Concepts. Strong hands-on experience with DBT. Comprehensive...

Job Description Position: Data Engineer (6-8 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Azure DataBricks (ADB) 2: Python 3: Pyspark 4: ETL and SQL Queries JOB RESPONSIBILITIES: Design, develop, and implement data pipelines using Azure Databricks and Python for data ingestion,...

Job Description Position: Senior Data Engineer (7-10 Years) Location: Gr. Noida Duration: Full Time MUST HAVE SKILLS: 1: Python 2: Spark 3: SQL 4: Azure Cloud (Databricks) 5: AI (GPT-4, OpenAI Codex) RESPONSIBILITIES: Design, develop, and maintain data ingestion and processing pipelines for various data...

Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...