Daipe framework development environment initializer


License
MIT
Install
pip install benvy==1.2.4.dev1

Documentation

Development environment initialization

for the Daipe stack

What it does

Local Computer

  • Extends the Pyfony dev environment initialization
  • Downloads Hadoop's winutils.exe and puts it into the project's .venv directory (Windows only)
  • Downloads Java 1.8 binaries and puts them into the ~/.databricks-connect-java dir
  • Creates the empty ~/.databricks-connect file

Databricks Repos Environment

  • Download and install poetry package manager
  • Install dependencies from poetry.lock
  • Set current working directory to project root
  • Append src folder to sys path
  • Set proper environment variables

Usage

%sh
pip install benvy==1.3.3
from benvy.databricks.repos import bootstrap  # noqa

bootstrap.install()
from benvy.databricks.repos import bootstrap  # noqa

bootstrap.setup_env()