Summary
Written in English from the original postingThe Data Specialist role involves architecting and maintaining scalable data solutions on Databricks. It includes developing ETL pipelines, data warehousing, data modeling, and stored procedures using SQL and Python. The role also covers performance monitoring, governance, and technical documentation.
Job description
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction. Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
Data Specialist
Primary Skills
- ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
Specialization
- Databricks Engineering: Data Architect
Job requirements
-
Experience Range: With at least 5 years of experience in data engineering, including 2+ years specifically working with Databricks and modern data platforms
Key Responsibilities:
1. Architect and optimize scalable data solutions on Databricks to ensure high performance and reliability
2. Develop and maintain robust ETL pipelines using advanced SQL, Python, and Databricks features for processing large-scale datasets
3. Design and implement data warehousing solutions, including data modeling and schema design, to support analytics and business intelligence
4. Automate data transformations and integrations by developing, testing, and deploying complex stored procedures with PLSQL and T-SQL
5. Lead requirements gathering and solution architecture with cross-functional teams to deliver high-quality data products
6. Monitor and troubleshoot data workflows, optimizing performance to maintain data accuracy, integrity, and availability
7. Enforce best practices in data governance, security, and compliance within Databricks environments
8. Document technical designs, engineering processes, and operational procedures for ongoing support and knowledge sharingRequired Skills:
1. Expertise in Databricks platform and ecosystem
2. Advanced ETL pipeline development
3. Advanced SQL, including query optimization and complex joins
4. Python programming for data engineering
5. Data warehousing implementation and data modeling
6. PLSQL and T-SQL for stored procedure development
7. Experience with modern data platform architecturesPreferred Skills:
1. Integration of Databricks with Azure or AWS cloud platforms
2. Proficiency in Apache Spark and distributed data processing
3. Experience with CI/CD automation for data engineering
4. Familiarity with data quality frameworks
5. Experience with real-time data streaming and processingDesired Qualifications:
1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline
2. Databricks Data Engineer Associate certification or higher
3. Microsoft Certified: Azure Data Engineer Associate or equivalent SQL/Python certification
The weekly Digest
The week's most transparent data engineering jobs in your inbox once a week.
Once a week, a few new jobs that state their salary, location and stack, plus links to the rest. No open tracking; clicks are counted per issue, not per person. Unsubscribe with one click.