SOLVED – Remove characters in from values pyspark

Advertisement

Problem – How to remove characters from column values pyspark sql? Only values should come and values like 10-25 should come as it is 546,654,10-25

I.e gffg546, gfg6544

azure-synapse-analytics
azure-databricks
azure-data-lake-storage

You May Also Like: SOLVED – How To Get All Data From Last 5 Minutes in SQL

SOLUTION

You can use this with Spark Tables + Pandas DataFrames:

Example:

Documentation for converting spark to pd

https://docs.databricks.com/spark/latest/spark-sql/spark-pandas.html

You May Also Like: SOLVED – How To Update Connection Policy Of Synapse Dedicated SQL Pools

We hope the solutions in the above-mentioned article were helpful. Feel free to share your views with us.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title="" rel=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>