Middle Data Engineer (Azure Databricks)
hace 11 días
Zaragoza
ppMiratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-drivenorganizationand our culture of Relentless Performance has enabled over 99% ofMiratech'sengagements to succeed by meeting or exceeding our scope, schedule, and/or budgetobjectivessince ourinceptionin 1989. /p pMiratech has coverage across 5 continents and operates in over 25 countries around the world. Miratech retains nearly 1000 full-time professionals, and our annual growth rate exceeds 25%. /p h3Job Description /h3 pWe are looking for abMiddle Data Engineer specialized in Azure Databricks /bto join our data platform team. /p pThe candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence. /p h3Key responsibilities: /h3 ul liDesign, develop, and maintain data pipelines using Azure Databricks /li liBuild and optimize data transformations using PySpark and SQL in Databricks /li liImplement and maintain Lakehouse architectures using Delta Lake /li liDevelop ETL/ELT pipelines orchestrated through Azure Data Factory /li liIntegrate data from multiple sources into the data platform and analytical layers /li liDesign and maintain data models and data warehouse structures for analytics /li liEnsure data quality, scalability, and performance of large-scale data processing pipelines /li liCollaborate with BI teams to support Power BI and reporting platforms /li liSupport and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required /li liContribute to the design of modern cloud-based data architectures /li /ul h3Qualifications /h3 ul lib3+ years of experience /bin Data Engineering or Data Warehouse development /li liExperience withbAzure Databricks /b /li liExperience developingbdata pipelines using PySpark and Spark SQL /b /li liSolid understanding of distributed data processing and big data concepts /li liExperience working withbDelta Lake and Lakehouse architectures /b /li liStrong SQL skills and experience withbSQL Server /brelational databases /li liExperience handling large datasets and performance optimization /li /ul h3Nice to have /h3 ul liExperience with Spark optimization techniques(partitioning, caching, cluster tuning) /li liExperience with structured streaming in Databricks /li liKnowledge of CI/CD pipelines for data platforms (Azure Devops) /li liFamiliarity with Power BI /li liExperience in migrating from traditional ETL process to cloud architectures /li /ul h3Soft Skills /h3 ul liStrong analytical and problem-solving skills. /li liAbility to work in collaborative environments and to adapt /li liCommitted to continuous learning and professional development, with a keen focus on advancing cloud computing expertise /li liTeam player /li liGood communication skills with technical and non-technical roles /li liIs proactive rather than reactive, actively identifying improvements and proposing solutions /li liIs comfortable working in dynamic environments where priorities and technologies evolve /li /ul h3Additional Information /h3 h3We offer: /h3 ul libCulture of Relentless Performance: /bjoin an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth. /li libCompetitive Pay and Benefits: /benjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program. /li libWork From Anywhere Culture: /bmake the most of the flexibility that comes with remote work. /li libGrowth Mindset: /b reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities. /li libGlobal Impact: /bcollaborate on impactful projects for top global clients and shape the future of industries. /li libWelcoming Multicultural Environment: /bbe a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events. /li libSocial Sustainability Values: /bjoin our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality. /li /ul p*Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other protected status under applicable law. /p /p #J-18808-Ljbffr