Admin: Created page with "← Geo*Data {{CustomTOC}} ==Instructions== Here is an '''Unsupported''' and '''Untested script''' that can be used with '''Windows PowerShell''' to Split the new `US.txt` file found in '''GeoDAT_202310''' into individual State Files. This may be useful for GeoData users that still want previous legacy format with every file separated instead of the updated all-in-one state file (US.txt). ===Download GeoData Update (GeoDAT_YYYYMM)=== Downloa..."

2023-11-17T01:28:14Z

Created page with "← Geo*Data {{CustomTOC}} ==Instructions== Here is an '''Unsupported''' and '''Untested script''' that can be used with '''Windows PowerShell''' to Split the new <code>US.txt</code> file found in '''GeoDAT_202310''' into individual State Files. This may be useful for GeoData users that still want previous legacy format with every file separated instead of the updated all-in-one state file (US.txt). ===Download GeoData Update (GeoDAT_YYYYMM)=== Downloa..."

New page

[[Geo*Data|← Geo*Data]]
{{CustomTOC}}
==Instructions==

Here is an '''Unsupported''' and '''Untested script''' that can be used with '''Windows PowerShell''' to Split the new <code>US.txt</code> file found in '''GeoDAT_202310''' into individual State Files.

This may be useful for GeoData users that still want previous legacy format with every file separated instead of the updated all-in-one state file (US.txt).

===Download GeoData Update (GeoDAT_YYYYMM)===
Download and Extract '''GeoDAT_202310''' folder onto your local desktop.

===Download and Extract GeoData_SplitState_Test.zip===
Download and Extract the <code>GeoData_SplitState_Test.zip</code> below and save the <code>Split_All_States_20231114.ps1</code> and <code>Split_By_State_Test.ps1</code> to the '''GeoDAT_202310''' folder.

For example: <code>C:\Users\Roxanne\Desktop\GeoDAT_202310\</code>

[[File:GeoData FAQ SplitFile.png|link=]]

===Open Windows PowerShell as Administrator===
Open "'''Windows PowerShell'''" as '''Administrator'''.

===Change Drive to GeoDAT_YYYYMM file path===
Change drive to the File path of '''GeoDAT_202310''' on your desktop and press '''Enter'''.

<pre>
For example:

PS C:\WINDOWS\system32> cd "C:\Users\Roxanne\Desktop\GeoDAT_202310\"

PS C:\Users\Roxanne\Desktop\GeoDAT_202310>
</pre>

==Determine if you want to Split the US.txt file==
Determine if you want to Split the US.txt file by '''all States at one time''' OR '''one desired state file'''.

===All States at One Time===
To Split the entire <code>US.txt</code> file into individual state files at one time, please perform the following steps:

Open the <code>Split_All_States_Test.ps1</code> in notepad to update the the following file paths before running the script in PowerShell:

<pre>
# $txtFilePath

# $idxFilePath

# $outputFolderPath
</pre>

Once the file paths are updated, Save and close the the file.

Type <code>.\Split_All_States_Test.ps1</code> in Windows PowerShell and hit enter to split all states at once.

'''NOTE:''' This will parse out the state files into individual state files as done previously and may take awhile, Press CTRL+C to Stop the script.

====File Contents: Split_All_States_Test.ps1====
<pre>
# Split GeoData - "US.txt" file by All States at once using the "US.idx" file.

# PLEASE NOTE:
# This script has NOT been tested and is NOT supported.
# This script may take some time. If using Windows Powershell, type "CTRL + C" to Stop script from running.

# The following paths must be updated before running:
# $txtFilePath
# $idxFilePath
# $outputFolderPath

# Last Updated: 2023-11-14

# Define the paths to the US.txt file and the US.idx file
$txtFilePath = "C:\Users\Roxanne\Desktop\GeoDAT_202310\TXT\US.txt"
$idxFilePath = "C:\Users\Roxanne\Desktop\GeoDAT_202310\TXT\US.idx"
$outputFolderPath = "C:\Users\Roxanne\Desktop\GeoDAT_202310\TXT"

# Read the index file
$indexLines = Get-Content $idxFilePath

# Create the output folder if it doesn't exist
if (!(Test-Path -Path $outputFolderPath -PathType Container)) {
New-Item -Path $outputFolderPath -ItemType Directory
}

# Initialize variable to keep track of the cumulative record count
$recordOffset = 0

foreach ($indexLine in $indexLines) {
# Parse the index line to get the state abbreviation and count
$stateAbbreviation, $stateFIPS, $count = $indexLine -split ','

# Convert the count to an integer
$count = [int]$count

if ($stateAbbreviation -and $count -gt 0) {
# Create a new output file with the state abbreviation
$outputFileName = "${stateAbbreviation}.txt"
$outputFilePath = Join-Path -Path $outputFolderPath -ChildPath $outputFileName

# Read and append lines from the US.txt file to the current output file
Get-Content $txtFilePath | Select-Object -Skip $recordOffset -First $count | Add-Content -Path $outputFilePath

# Update the cumulative record count for the next state
$recordOffset += $count

Write-Host "Splitting complete for $stateAbbreviation."
}
}

Write-Host "Splitting complete for all states."
</pre>

===One Desired State File===
To Split an individual state file out of the <code>US.txt</code> one at a time, please perform the following steps:

Open the <code>Split_By_State_Test.ps1</code> in notepad to update the the following file paths before running the script in PowerShell:

<pre>
$txtFilePath

$idxFilePath

$outputFolderPath

$desiredState
</pre>

Once the file paths are updated, Save and close the the file.

Type <code>.\Split_By_State_Test.ps1</code> in Windows PowerShell and hit '''enter''' to split an individual desired state.

'''NOTE:''' Please note the new State file may take a moment to display in the TXT folder depending on the size.

====File Contents: Split_By_State_Test.ps1 ====
<pre>
# Split GeoData - "US.txt" file by Individual State using the "US.idx" file.

# PLEASE NOTE:
# This script has NOT been tested and is NOT supported.

# The following paths must be updated before running:
# $txtFilePath
# $idxFilePath
# $outputFolderPath
# $desiredState

# Last Updated: 2023-11-14

# Define the paths to the US.txt file and the US.idx file
$txtFilePath = "C:\Users\Roxanne\Desktop\GeoDAT_202310\TXT\US.txt"
$idxFilePath = "C:\Users\Roxanne\Desktop\GeoDAT_202310\TXT\US.idx"
$outputFolderPath = "C:\Users\Roxanne\Desktop\GeoDAT_202310\TXT"

# Read the index file
$indexLines = Get-Content $idxFilePath

# Create the output folder if it doesn't exist
if (!(Test-Path -Path $outputFolderPath -PathType Container)) {
New-Item -Path $outputFolderPath -ItemType Directory
}

# Initialize variables to keep track of line counts
$currentState = $null
$recordOffset = 0

# Define the state you want to parse (e.g., "AL" for Alabama)
$desiredState = "AL"

# Loop through the index lines
foreach ($indexLine in $indexLines) {
# Parse the index line to get the state abbreviation and count
$stateAbbreviation, $stateFIPS, $count = $indexLine -split ','

# Convert the count to an integer
$count = [int]$count

# Check if the current state matches the desired state
if ($stateAbbreviation -eq $desiredState -and $count -gt 0) {
# Create a new output file with the state abbreviation
$outputFileName = "${stateAbbreviation}.txt"
$outputFilePath = Join-Path -Path $outputFolderPath -ChildPath $outputFileName

# Read and write lines from the US.txt file to the current output file
Get-Content $txtFilePath | Select-Object -Skip $recordOffset -First $count | Set-Content -Path $outputFilePath

Write-Host "Splitting complete for $stateAbbreviation."
break # Exit the loop after processing the desired state
}

# Update the record offset for the next state
$recordOffset += $count
}

Write-Host "Splitting complete for $desiredState."
</pre>

[[Category:FAQ]]
[[Category:Geo*Data]]

Geo*Data:FAQ - Revision history