
Senior Big Data Specialist
3 days ago
Job Overview:
The Data Engineer role involves designing, implementing and maintaining large-scale data systems. This position requires a strong background in Big Data technologies and proficiency in Python and PySpark.
Key Responsibilities:
- Design and develop pySpark applications using Spark Dataframes in Python.
- Optimize spark jobs that process huge volumes of data for improved efficiency and scalability.
- Implement version control using Git to manage code changes and collaborate with team members.
- Utilize Amazon's Analytics services such as Amazon EMR, Amazon Athena, AWS Glue to process and analyze large datasets.
- Experience with Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 is highly desirable.
- Good knowledge of datawarehousing concepts including dimensions, facts, schemas- snowflake, star etc.
- Familiarity with columnar storage formats like Parquet, Avro, ORC and compression techniques such as Snappy, Gzip is essential.
- Proficiency in one or more AWS databases such as Aurora, RDS, Redshift, ElastiCache, DynamoDB is required.
Requirements:
- 5+ years of overall IT experience
- Hands on experience in Python and PySpark programming
- Expertise in Amazon's Analytics services and Amazon's Compute services
- Knowledge of data warehousing concepts and columnar storage formats
-
Highly Experienced Big Data Engineer
4 hours ago
Solapur, Maharashtra, India beBeeData Full time ₹ 1,95,00,000 - ₹ 2,51,50,000Big Data specialists play a vital role in organizations that deal with large volumes of data.Job DescriptionThe ideal candidate will have expertise in big data technologies, including PySpark/Scala Spark/Java Spark SQL. They should have a strong understanding of data structures and algorithms, as well as experience in building data pipelines, transformation...
-
Senior Big Data Developer Wanted
10 hours ago
Solapur, Maharashtra, India beBeeDataScience Full time ₹ 20,00,000 - ₹ 25,00,000Big Data Developer JobWe are seeking a skilled Big Data developer to join our team. The ideal candidate will have hands-on experience with Scala, Spark, Hive, and Hadoop.The successful candidate will be responsible for developing and optimizing data processing pipelines using the latest big data technologies.Strong SQL skills and experience working with...
-
Big Data Professional
4 hours ago
Solapur, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Overview:We are seeking an experienced professional with a strong background in Big Data, Scala, AWS, and Python or Java.Utilize data analytics tools to drive business growthDevelop and maintain scalable big data architecturesCollaborate with cross-functional teams to identify opportunities for improvementRequired Skills & Qualifications:Proven...
-
Big Data Architect
10 hours ago
Solapur, Maharashtra, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,50,000Job Title: Big Data ArchitectA leading organization is seeking a skilled Databricks Engineer to join their team in a remote work setup.We are looking for an experienced data engineer with a strong background in big data architecture to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks...
-
Big Data Processing Specialist
5 days ago
Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000As a seasoned Data Engineer, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB)Develop and maintain PySpark applications for big data processingCollaborate with cross-functional teams to integrate...
-
Big Data Systems Engineer
10 hours ago
Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000Job Title: Big Data Systems Engineer">Our company is looking for a skilled and experienced Big Data Systems Engineer to join our team. As a Big Data Systems Engineer, you will be responsible for designing, implementing, and managing large-scale distributed data systems.">Key Responsibilities:">Design and implement scalable and high-performance big data...
-
Big Data Systems Engineer
10 hours ago
Solapur, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000Job Opportunity: We are seeking a highly skilled Data Engineer to build and maintain large-scale data systems.">Prior experience in developing and deploying cloud-based data platforms using big data technologies like Hadoop, Spark, and NoSQL databases.Strong skills in programming languages such as Java, Python, Scala, and SQL.
-
Chief Data Engineering Specialist
4 days ago
Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Senior Data Engineer OpportunityWe are seeking a skilled Senior Data Engineer to help design and implement an application for a large retailer.The ideal candidate will have hands-on coding expertise in Python and Pyspark, with strong experience in Telemetry, Big Data, and backend engineering.Domain experience in IoT systems, HVAC/refrigeration equipment, and...
-
Data Pipelines Specialist
10 hours ago
Solapur, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Senior Data Engineering SpecialistWe are seeking an experienced Senior Data Engineer to join our team.This is a critical role in designing, developing, and maintaining data pipelines and infrastructure.Your Key Responsibilities:Designing and implementing scalable data pipelines using Azure Data Factory and Databricks for efficient data ingestion,...
-
Senior Data Workflow Specialist
4 days ago
Solapur, Maharashtra, India beBeeDataArchitect Full time ₹ 1,00,00,000 - ₹ 1,50,00,000Informatica Data Architect RoleThis position involves designing, developing and testing ETL architecture for a leading client based in Bengaluru. The focus is on delivering scalable data workflows using Informatica BDM/DEI. Main Responsibilities: Design and develop ETL workflows using Informatica BDM/DEI. Integrate data from structured and unstructured...