Alexander abij

## fileformats_spark_duckdb.ipynb

      
              1 file
            
          
              0 forks
            
          
                0 comments
              
            
              0 stars
            
          
                abij
                / fileformats_spark_duckdb.ipynb
            
            
              Created
              December 31, 2024 14:26
            
              
                Compare impact of file formats using Spark and DuckDB
              
          
      Loading

      Sorry, something went wrong. Reload?
      Sorry, we cannot display this file.
      Sorry, this file is invalid so it cannot be displayed.
      
          Viewer requires iframe.
      
    
## datadog-install-agent.sh
#!/bin/bash

# Inspiration based on: https://docs.databricks.com/_static/notebooks/datadog-init-script.html

# Improvements:
# - Use 'spark_url' in config (instead of resourcemanager_uri)
# - Use Databricks Secrets to store and retrieve datadog-api-key
# - Works with SingleNode-clusters
# - Update datadog-spark integration (when needed), to support Structured Streaming metrics.
	#!/bin/bash

	# Inspiration based on: https://docs.databricks.com/_static/notebooks/datadog-init-script.html

	# Improvements:
	# - Use 'spark_url' in config (instead of resourcemanager_uri)
	# - Use Databricks Secrets to store and retrieve datadog-api-key
	# - Works with SingleNode-clusters
	# - Update datadog-spark integration (when needed), to support Structured Streaming metrics.