Transformative Big Data Solutions Expert
1 week ago
Data Engineer Job Posting
Our organization seeks a highly skilled Data Engineer to create and maintain optimal data pipeline architecture. This role will also involve designing and implementing events/streaming based architecture, as well as identifying and implementing internal process improvements.
About the Role:
- Create infrastructure for efficient extraction, transformation, and loading of data from various sources using SQL and cloud technologies.
- Develop data tools for analytics and data scientist team members to support their work.
- Collaborate with data scientists to enhance functionality in our data systems.
Necessary Skills and Qualifications:
- Proficiency in either Scala or Python, expertise in Spark, and experience with performance tuning and optimization. DBT is required.
- Experience with big data tools: HDFS/S3, Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
- Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with cloud services: AWS/GCP.
- Experience with stream-processing systems: Spark-Streaming/Flink, etc.
- Experience with object-oriented/object function scripting languages: Java, Scala, etc.
- Experience building and optimizing 'big data' pipelines, architectures, and datasets.
Benefits of Working with Us:
- We are looking for a candidate with 2+ years of experience in a Data Engineer role who can work independently and collaboratively in a dynamic environment.
About Our Organization:
We are a forward-thinking organization seeking talented individuals to join our team.
-
Big Data Architect
1 week ago
India Bloom Consulting Services Full timeNot Disclosed Experience **12 - 16 Years** Offered Salary **Lakh** Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end...
-
Big Data Architect
1 week ago
India Bloom Consulting Services Full timeNA Experience **12 - 16 years** Offered Salary Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end tools). 9+ years of...
-
Big Data Solutions Architect
2 weeks ago
India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewThe Scala Big Data Engineer will design, develop and optimize data pipelines and ETL workflows. They will work with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data processing.Key Responsibilities:Design and develop data pipelines and ETL workflowsWork with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data...
-
Big Data Solution Architect
2 weeks ago
India EPAM Systems Full timeEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...
-
Data Transformation Expert
2 weeks ago
India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Senior Data Transformation LeadWe are seeking a seasoned expert in data transformation to lead our efforts in process optimization and innovation using AI, data science, and Lean Six Sigma.Job DescriptionThis role offers an exciting opportunity to drive cost-efficiency, process optimization, and innovation across global operations. As a Senior Data...
-
Big Data Administrator
6 days ago
India HNM Solutions Full time**Big Data Administrator**: - (Engagement - 6 Months+) _ **Experience**:5+ years **Key Skills**:Hadoop ecosystem (HDFS, YARN, Hive, Impala), Cloudera/HDP administration, Linux, security, monitoring **Responsibilities**:Administer and monitor big data infrastructure & jobs, manage user access, data storage, and cluster health; implement security controls...
-
Senior Big Data Analyst
1 week ago
India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000Job OpportunityAbout the Role:Are you a skilled professional seeking a challenging role that leverages your expertise in big data and analytics? Look no further!Responsibilities:Develop and implement big data solutions using Spark, SQL, Hive, and Scala.Collaborate with cross-functional teams to design and deliver high-quality data-driven insights.Stay...
-
Senior Big Data Engineering Expert
6 days ago
India beBeeBigData Full time ₹ 8,00,000 - ₹ 12,00,000Job Title: Big Data Engineer Lead">Job DescriptionWe are seeking a skilled and experienced Big Data Engineer to lead our team in the implementation of big data solutions. As a Big Data Engineer Lead, you will be responsible for designing, developing, and deploying large-scale data processing systems.You will work closely with cross-functional teams to...
-
Big Data Expert
6 days ago
India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000Job OpportunityDeltaCubes is seeking a Senior Data Engineer to fill a key position. This role involves designing and developing large-scale data pipelines, as well as utilizing Google Cloud tools and technologies.Key Responsibilities:Design, develop, test, and maintain data acquisition pipelines for structured and unstructured dataCreate complex datasets...
-
Big Data Engineering Specialist
1 week ago
India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000About TredenceTredence is a global analytics services and solutions company. We attract the greatest talent in data analytics and data science, with capabilities ranging from data visualization to advanced analytics.We build scalable big data solutions on cloud platforms like GCP and Azure in a cost-effective and easily scalable manner for our clients.We...
