Snowflake announced at its Snowday event that data scientists, data engineers, and application developers can now use Python, in addition to Java and Scala, natively within Snowflake as part of Snowpark, Snowflake’s developer framework. With Snowpark for Python, developers will be able to collaborate on data in their preferred language. At the same time, they can leverage the security, governance, and elastic performance of Snowflake’s platform to build scalable, optimized pipelines, applications, and machine learning workflows. Snowpark for Python is currently in private preview. As a result of the recently announced partnership with Anaconda, Snowflake users can now access the popular ecosystem of Python open source libraries, without the need for manual installs and package dependency management. Additional Snowflake and Snowpark capabilities include:
- Cross-cloud account replication
- Improved replication performance
- Expanded governance capabilities and integration
- Snowpark: Stored Procedures
- Snowpark: Unstructured File Processing
- Snowpark: Logging Framework
Datadobi Software, provider of unstructured data management software, announced enhancements to its vendor-neutral unstructured data mobility engine with the introduction of DobiMigrate’s API. Version 5.13 will allow organizations to programmatically configure unstructured data migrations using the API.
Using the DobiMigrate API, customers and partners can now extend existing automated storage provisioning workflows with the necessary data migration steps. Organizations can first use the storage system APIs to provision a new group of on-premises or cloud storage and then use the DobiMigrate API to set up the NAS or object migration. Following the cutover to the new storage, the administrator can then again use storage systems APIs to deprovision the original storage.
Customers can also use the DobiMigrate API in conjunction with the Datadobi file system assessment service. The file system assessment service provides customers with insights into the state of the unstructured data estate. Characteristics of file systems from a global level through individual storage systems and sub-file servers/virtual file servers is provided in a detailed report, allowing customers to make informed decisions on how to organize and move their data. The DobiMigrate API can then be used to establish the required migrations of individual datasets between systems.