Senior Data Architect (Azure, Databricks)

Company: Creative Data is a pioneering consultancy firm dedicated to empowering organizations with sustainable data and AI strategies. We specialize in designing open and efficient data architectures that drive innovation while promoting accessibility, transparency, and ethical data practices. Our mission is to harness the power of data for a positive impact on society and the environment.

Role: We all love flexibility and focus on results rather than counting hours in a rigid workplace culture. You will be an integral part of our international team, actively contributing to our product development and engaging in interesting projects. We provide an appealing compensation package aligned with European standards, a pleasant and flexible remote-first work environment, and encourage continuous professional development.

Person: We are seeking individuals who embody the spirit of an autodidact, bringing the curiosity, dedication, passion and desire to continuously learn and excel. The ideal candidate should be self-motivated, capable of independently managing tasks, generating innovative ideas, and proactively taking initiative, as we cultivate autonomy and personal freedom in our work environment.

Skills:

Must-haves:

• 10+ years of experience in the Azure ecosystem, with deep expertise in Databricks
• Proven track record in designing and implementing data pipelines and data platforms (Data Warehouses/Lakehouses)
• Strong knowledge of modern data formats and table standards, particularly Delta Lake
• Experience integrating Generative AI, preferably with Azure AI Foundry and/or LangChain
• Advanced data modeling and SQL expertise
• Back-end development experience using Python to build APIs and web services
• Proficient in CI/CD practices using Azure DevOps or GitHub
• Demonstrated ability to lead architectural decisions across cross-functional teams

Nice-to-haves:

• Hands-on experience with Microsoft Power BI
• Experience with Databricks Unity Catalog migration
• Familiarity with Apache Arrow and single-node engines like DuckDB or Polars
• Experience with real-time/streaming data architectures and query engines
• Hands-on experience with Apache NiFi
• Active contributor to open-source projects
• Working knowledge of Docker and Kubernetes

Contract and process: This is a freelance contract (autónomo) for a fully remote position, based in Spain. The role is offered as an initial 6-month engagement, with near full-time dedication expected. Extensions may be considered based on performance and evolving project needs.