Big Data Engineer
3 weeks ago
Job Title :- Data Engineer - Pyspark
Experience: 5 to 8 Years
Location: Pune/Hyderabad
Job Description
Required Skills:
5+ years of experience in Big data and pyspark
Must-Have
Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL
Good-to-Have
Good Spark, Pyspark,Big Data experience
Spark UI/Optimization/debugging techniques
Good python scripting skills
Intermediate SQL exposure – Subquery, Joins, CTE’s
Database technologies
AWS EMR, S3, IAM, Lambda, SNS, SQS
Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL
Experience working on Data Engineering projects
Good Understanding of SQL
Good understanding of Unix and HDFS commands
Communication
Experience working on Data Analytics and Pyspark
Thanks & Regards ,
Manasi Prava Natha
-
Big Data Engineer
23 hours ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per yearWe are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.
-
Big Data Engineer
5 days ago
Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per yearProfile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Deqode Full time ₹ 5,00,000 - ₹ 25,00,000 per yearBig Data Engineer Tech Stack: Python, Hive & Apache Spark Java & Advanced SQL Hadoop & Big Data Ecosystem Apache Airflow & ETL Pipelines Docker & Containerization Data Modelling & Warehousing Experience- 5 years Share your updated resume now.
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per yearKey skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAs a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...
-
Big Data Engineers/Senior Engineers
6 days ago
Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...
-
Big Data Engineer
3 days ago
Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per yearLocation – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...