
Big Data Engineer
4 days ago
Job Title: Big Data Engineer
Overview:
We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems.
Key Responsibilities:
- Design and develop scalable big data architectures using technologies like AWS, Python, and PySpark.
- Build and deploy high-performance data pipelines using Spark Dataframes in Python.
- Optimize and troubleshoot complex data processing jobs that handle large volumes of data.
- Work with version control tools like Git to manage code changes and collaborate with team members.
- Develop expertise in Amazon's Analytics services like Amazon EMR, Amazon Athena, and AWS Glue.
- Collaborate with cross-functional teams to design and implement data warehousing solutions using dimensional modeling techniques.
- Stay up-to-date with the latest advancements in big data technologies and contribute to knowledge sharing within the team.
Required Skills and Qualifications:
- 5+ years of experience in big data technologies, including hands-on experience with Python, PySpark, and AWS.
- Proven track record of designing and deploying scalable data processing systems.
- Strong understanding of data warehousing concepts, including dimensional modeling and ETL processes.
- Experience with columnar storage formats like Parquet, Avro, and ORC.
- Good knowledge of compression techniques like Snappy and Gzip.
- Familiarity with AWS databases like Aurora, RDS, Redshift, ElastiCache, and DynamoDB.
Benefits:
- Competitive salary and benefits package.
- Ongoing training and professional development opportunities.
- Collaborative and dynamic work environment.
-
Senior Big Data Engineer
2 days ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000Key Job ResponsibilitiesDevelop, deploy, and maintain large-scale data systems using Apache Druid.Required Skills & Qualifications5+ years of experience in big data engineering with a strong focus on real-time analytics.Hands-on expertise in SQL, query optimization, and data modeling for Druid.Experience integrating Druid with Kafka, Hadoop, Spark, or...
-
Big Data Solutions Engineer
2 days ago
Surat, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000Job Title: Data ArchitectA company in the data engineering sector is looking for a highly skilled professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join its team.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and...
-
Big Data Developer
2 hours ago
Surat, Gujarat, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000Job Overview:We are seeking a talented professional to join our team as a Big Data Developer.Key Responsibilities:Design and develop efficient programs/systems for data analyticsTranslate client requirements into system requirementsEstimate work requirements to provide information on project estimationsCode, test, and document new or modified data...
-
Big Data Expert Wanted
2 days ago
Surat, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data Expert WantedWe're seeking a seasoned data professional to spearhead our big data endeavors. The ideal candidate will have 6-12 years of experience in managing and processing large datasets using PySpark, Hive, and other relevant tools.Mandatory Skills:PySpark: Proficiency in crafting complex Spark jobs and optimizing performanceHive: Experience...
-
Lead Big Data Specialist
4 days ago
Surat, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000We seek a Senior Data Engineer to join our team.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.Optimize data architectures and...
-
Senior Big Data Architect
2 days ago
Surat, Gujarat, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000Job Description\Sigmoid empowers enterprises to make data-driven decisions by integrating advanced data engineering with AI consulting. Our global team specializes in cloud data modernization, predictive analytics, and DataOps, supported by multiple delivery centers and innovation hubs.\As a Technical Lead, you will be responsible for building a...
-
High-Profile Data Engineer
1 day ago
Surat, Gujarat, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 30,00,000Job DescriptionWe are seeking an experienced Data Engineering professional to design, develop and implement scalable ETL workflows using Informatica BDM/DEI.This role involves understanding client requirements, designing, developing and testing of ETL architecture, transformation jobs and workflow schedules for a high-profile overseas project based in...
-
Senior Big Data Specialist
2 days ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Role SummaryWe are seeking a skilled Data Engineer to join our team.Job Description:Achieve data processing goals by applying expertise in Trino (PrestoSQL) to optimize performance and scalability.Leverage knowledge of distributed computing frameworks and large-scale data systems to ensure seamless integration and high-quality output.Familiarize yourself...
-
Chief Data Architect
1 day ago
Surat, Gujarat, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Design and Develop Scalable Data ArchitecturesAs a Big Data Engineer, you will play a crucial role in designing and developing scalable data architectures to extract insights from large datasets.Main Responsibilities:Develop big data pipelines using PySpark, Hive, and other relevant technologies.Work on exposing data ingestion capabilities from disparate...
-
Data Engineering Specialist
2 hours ago
Surat, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000Job OverviewOur organization is a leader in the tech industry, dedicated to delivering innovative solutions that drive business transformation. We foster a collaborative and inclusive work environment that encourages professional growth and innovation.The ideal candidate will have experience with data pipeline design, development, and maintenance on Google...