
Senior Data Engineer
5 days ago
Senior Data Engineer - Databricks
About AppenAppen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In addition, we utilize the industry's most advanced AI-assisted data annotation platform to collect and label various types of data like images, text, speech, audio, and video.
Our data is crucial for building and continuously improving the world's most innovative artificial intelligence systems and Appen is already trusted by the world's largest technology companies. Now with the explosion of interest in generative AI, Appen is helping leaders in automotive, financial services, retail, healthcare, and governments the confidence to deploy world-class AI products.
At Appen, we are purpose driven. Our fundamental role in AI is to ensure all models are helpful, honest, and harmless, so we firmly believe in unlocking the power of AI to build a better world. We have a learn-it-all culture that values perspective, growth, and innovation. We are customer-obsessed, action-oriented, and celebrate winning together.
At Appen, we are committed to creating an inclusive and diverse workplace. We are an equal opportunity employer that does not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Position Summary We're hiring a Senior Data Engineer with strong experience in AWS and Databricks to build scalable data solutions that power next-gen AI and machine learning. Join our fast-growing team to work on impactful projects, collaborate with top talent, and drive innovation at scale. Key Responsibilities:
- Design, build, and manage large-scale data infrastructures using a variety of AWS technologies such as Amazon Redshift, AWS Glue, Amazon Athena, AWS Data Pipeline, Amazon Kinesis, Amazon EMR, and Amazon RDS.
- Design, develop, and maintain scalable data pipelines and architectures on Databricks using tools such as Delta Lake, Unity Catalog, and Apache Spark (Python or Scala), or similar technologies.
- Integrate Databricks with cloud platforms like AWS to ensure smooth and secure data flow across systems.
- Build and automate CI/CD pipelines for deploying, testing, and monitoring Databricks workflows and data jobs.
- Continuously optimize data workflows for performance, reliability, and security, applying Databricks best practices around data governance and quality.
- Ensure the performance, availability, and security of datasets across the organization, utilizing AWS's robust suite of tools for data management.
- Collaborate with data scientists, software engineers, product managers, and other key stakeholders to develop data-driven solutions and models.
- Translate complex functional and technical requirements into detailed design proposals and implement them.
- Mentor junior and mid-level data engineers, fostering a culture of continuous learning and improvement within the team.
- Identify, troubleshoot, and resolve complex data-related issues.
- Champion best practices in data management, ensuring the cleanliness, integrity, and accessibility of our data.
- Optimize and fine-tune data queries and processes for performance. Evaluate and advise on technological components, such as software, hardware, and networking capabilities, for database management systems and infrastructure.
- Stay informed on the latest industry trends and technologies to ensure our data infrastructure is modern and robust.
- 5-7 years of hands-on experience with AWS data engineering technologies, such as Amazon Redshift, AWS Glue, AWS Data Pipeline, Amazon Kinesis, Amazon RDS, and Apache Airflow.
- Hands-on experience working with Databricks, including Delta Lake, Apache Spark (Python or Scala), and Unity Catalog.
- Demonstrated proficiency in SQL and NoSQL databases, ETL tools, and data pipeline workflows.
- Experience with Python, and/or Java.
- Deep understanding of data structures, data modeling, and software architecture.
- Experience with AI and machine learning technologies is highly desirable.
- Strong problem-solving skills and attention to detail.
- Self-motivated and able to work independently, with excellent organizational and multitasking skills.
- Exceptional communication skills, with the ability to explain complex data concepts to non-technical stakeholders.
- Bachelor's Degree in Computer Science, Information Systems, or a related field. A Master's Degree is preferred.
-
Lead/Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Data Economy Full time ₹ 20,00,000 - ₹ 35,00,000 per yearWe are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Property Data Engineer
1 week ago
Hyderabad, Telangana, India ICE Data Services Full time ₹ 10,00,000 - ₹ 25,00,000 per yearJob PurposeThe Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...
-
Senior Data Engineer
3 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions. Manage a...
-
Senior Data Engineer/Architect
6 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...
-
Aws Data Engineer
2 weeks ago
Hyderabad, Telangana, India Data Economy Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Unify Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany DescriptionUnify Technologies is a leading digital engineering company committed to helping global clients build high-quality software products quickly and affordably. With extensive experience in software product engineering practices, Unify Technologies delivers custom software solutions. We collaborate with industry leaders across multiple...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Cognine Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset. As a Great...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Blurgs AI Full time ₹ 4,00,000 - ₹ 8,00,000 per yearJob Title: Senior Data Engineer - Real-Time, batch Processing & Containerization (Pulsar, Flink, Kubernetes)Location: HyderabadAbout us:Blurgs AI is a deep-tech startup focused on maritime and defence data-intelligence solutions, specialising in multi-modal sensor fusion and data correlation. Our flagship product, Trident, provides advanced domain awareness...