Re: How can I delete entire lines based on a search expression in vi? (1066 Views)
Reply
Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 1 of 22 (1,076 Views)
Accepted Solution

How can I delete entire lines based on a search expression in vi?

[ Edited ]

I need to remove the following lines from a file:

 

<AccountType>Some stuffs in here also</AccountType>

 

How can I do this with vi or another hpux program?

 

Thank you,

 

Eric Antunes

Each and every day is a good day to learn.
Honored Contributor
H.Merijn Brand (procura
Posts: 6,189
Registered: ‎10-13-1997
Message 2 of 22 (1,066 Views)

Re: How can I delete entire lines based on a search expression in vi?

Assuming the (XML like) lines are all on a single line each:

 

In vi

 

  :g/<AccountType>/d

 

With perl:

 

  $ perl -ni -e'm/ <AccountType>/ or print' file.txt

 

But that is only safe if there is onlo what you show on a single line. If text folds and the closing tag is on the next line, or if other text is on the same line, this is going to fail.

 

Is the whole file valid HTML? or XML? 

Enjoy, Have FUN! H.Merijn
Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 3 of 22 (1,062 Views)

Re: How can I delete entire lines based on a search expression in vi?

Hi Merijn,

It worked! This is a valid XML file but I need to remove that part in the entire file.

Thank you,

Eric
Each and every day is a good day to learn.
Acclaimed Contributor
Dennis Handly
Posts: 25,294
Registered: ‎03-06-2006
Message 4 of 22 (1,059 Views)

Re: How can I delete entire lines based on a search expression in vi?

[ Edited ]

><AccountType>Some stuff in here also</AccountType>

 

You can be more pedantic:

:g:<AccountType>.*</AccountType>:d

 

If you need to anchor the lines to beginning and end:

:g:^<AccountType>.*</AccountType>$:d

 

And you can use these in sed.

Honored Contributor
H.Merijn Brand (procura
Posts: 6,189
Registered: ‎10-13-1997
Message 5 of 22 (1,057 Views)

Re: How can I delete entire lines based on a search expression in vi?

If you want to be more pedantic, please escape the inside slash :)

:g/<AccountType>.*<\/AccountType>/d

If you need to anchor the lines to beginning and end:

 

Assuming \s is whitespace in your editor, and it supports * for greedy and ? non-greedy modifiers


:g/^\s*<AccountType>.*?<\/AccountType>\s*$/d

Otherwise greedy .* might get way to much :)

 

And you can (maybe) use these in sed (depending on what version od sed you have).

Enjoy, Have FUN! H.Merijn
Acclaimed Contributor
Dennis Handly
Posts: 25,294
Registered: ‎03-06-2006
Message 6 of 22 (1,054 Views)

Re: How can I delete entire lines based on a search expression in vi?

[ Edited ]

>If you want to be more pedantic, please escape the inside slash :)

 

Oops, done, replaced by a colon ":".  :-(

Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 7 of 22 (1,037 Views)

Re: How can I delete entire lines based on a search expression in vi?

I don't need to be pedantic. :-)

 

Thank you guys.

 

 

Each and every day is a good day to learn.
Acclaimed Contributor
James R. Ferguson
Posts: 21,184
Registered: ‎07-06-2000
Message 8 of 22 (1,031 Views)

Re: How can I delete entire lines based on a search expression in vi?


Eric Antunes wrote:

I don't need to be pedantic. :-)


Learning precision when deploying regular expressions will keep you from matching when you *don't* want to match as well as allow you to match when you should.  Form the good habits early and save yourself countless hours of pain.

 

Regards!

 

...JRF...

Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 9 of 22 (925 Views)

Re: How can I delete entire lines based on a search expression in vi?

Hi again,

 

I didn't need to be pedantic since this is a XML file with serious parse errors. So, things like <AccountType>,<EMail/>, <Contact/>... could safely be removed. But now it gets harder (at least for me, a DBA): I need to add stuffs to the file.

 

For example, I would like to add the line "<SelfBillingIndicator>0</SelfBillingIndicator>" before each line "</Customer>"

 

How can I do that in vi?

 

Thank you,

 

Eric

Each and every day is a good day to learn.
Acclaimed Contributor
James R. Ferguson
Posts: 21,184
Registered: ‎07-06-2000
Message 10 of 22 (918 Views)

Re: How can I delete entire lines based on a search expression in vi?


Eric Antunes wrote:

For example, I would like to add the line "<SelfBillingIndicator>0</SelfBillingIndicator>" before each line "</Customer>"

 

How can I do that in vi?

 


Using 'vi' search for the first line with "Customer":

 

Insert your "SelfbillingIndicator" line above it by (O)pening a new line above it.

 

After you have inserted the new line, yank (yy) a copy of it.

 

Hit 'n' to continue to search forward for "Customer" and when you reach a matching line, use 'P' to put the yanked buffer above the "Customer" line.

 

Regards!

 

...JRF...

Honored Contributor
H.Merijn Brand (procura
Posts: 6,189
Registered: ‎10-13-1997
Message 11 of 22 (916 Views)

Re: How can I delete entire lines based on a search expression in vi?

vi

 

  :g,</Customer>,s,^,<SelfBillingIndicator>0</SelfBillingIndicator>\n,

 

(if your version of vi does not support \n, use Ctrl-V - Enter)

 

perl

 

 $ perl -pe'm{ </Customer>} and print "<SelfBillingIndicator>0</SelfBillingIndicator>\n"' file.xml

Enjoy, Have FUN! H.Merijn
Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 12 of 22 (897 Views)

Re: How can I delete entire lines based on a search expression in vi?

Hi again,

 

The vi command worked perfectly with Ctrl-V-Enter.

 

Now, I have this pattern:

 

    <BillingAddress>
      <AddressDetail>Stuffs a</AddressDetail>
      <City>Stuffs b</City>
      <PostalCode>Stuffs c</PostalCode>
      <Country>Stuffs d</Country>
    </BillingAddress>
    <ShipFromAddress>
      <AddressDetail/>
      <City/>
      <PostalCode/>
      <Country/>
    </ShipFromAddress>

 

And would like to correct/fiil the ShipFromAddress part with the BillingAddress data, to look like this:

 

 

    <BillingAddress>
      <AddressDetail>Stuffs a</AddressDetail>
      <City>Stuffs b</City>
      <PostalCode>Stuffs c</PostalCode>
      <Country>Stuffs d</Country>
    </BillingAddress>
    <ShipFromAddress>
      <AddressDetail>Stuffs a</AddressDetail>
      <City>Stuffs b</City>
      <PostalCode>Stuffs c</PostalCode>
      <Country>Stuffs d</Country>

    </ShipFromAddress>



This is really getting harder...

 

Thank you,

 

Eric



Each and every day is a good day to learn.
Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 13 of 22 (894 Views)

Re: How can I delete entire lines based on a search expression in vi?

[ Edited ]

I'm trying things like this in vi:

 

:g,<AddressDetail/>,6^Uyy6^D,s,p

 

:g,<AddressDetail/>,!6^Uyy6^D,s,p

 

:g,<AddressDetail/>,6^U,yy,6^D,s,p

For this last one, vi says "U: Not an editor command"

 

But no success for now...

Each and every day is a good day to learn.
Honored Contributor
H.Merijn Brand (procura
Posts: 6,189
Registered: ‎10-13-1997
Message 14 of 22 (885 Views)

Re: How can I delete entire lines based on a search expression in vi?

By the time your requirements get as complicated as this, you should not want to "solve" that in vi

 

I'd suggest perl, but I am clearly biased

 

Take the suggestions from this thread and create yourself a simple perl script that modifies the original file and outputs the result to *another* file, so you can then alter the script as long and often as you want till you get where you want to be.

 

Of course we can help with the specifics, but in order to believe in this new approach you will have to follow your own signature: learn something new every day. Don't be affraid this new approach will take too long. Its time lost is regained manyfold very very soon after. When I see the time span between your posts, the time you would have needed to learn the basics would already have been regained. 

Enjoy, Have FUN! H.Merijn
Acclaimed Contributor
James R. Ferguson
Posts: 21,184
Registered: ‎07-06-2000
Message 15 of 22 (880 Views)

Re: How can I delete entire lines based on a search expression in vi?

[ Edited ]

HI Eric:

 

A Perl script that meets your requirements might be:

 

#!/usr/bin/perl
use strict;
use warnings;
my $insert = 0;
my @a = ();
while (<>) {
    if (m{<BillingAddress>}..m{</BillingAddress>}) {
        $insert = 1;
        if (m{</?BillingAddress>}) {
            print;
            next;
        }
        push @a, $_;
    }
    if (m{<ShipFromAddress>}..m{</ShipFromAddress>}) {
        print if m{</?ShipFromAddress>};
        if ($insert) {
            $insert = 0;
            print @a;
            @a = ();
        }
        next;
    }
    print;
}
1;

Assuming you called the script 'reformat', run it as:

 

# ./reformat file

 

Regards!

 

...JRF...

Honored Contributor
H.Merijn Brand (procura
Posts: 6,189
Registered: ‎10-13-1997
Message 16 of 22 (876 Views)

Re: How can I delete entire lines based on a search expression in vi?

JRF, s/\A/#/ :)

 

(first line of a script starts with #!/path/to/program (the # was missing)

 

More serious, once you get here, it might be worth looking at XML parser modules and modify the content in a more structural way. When done, use the module's methods to write valid XML to disk 

Enjoy, Have FUN! H.Merijn
Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 17 of 22 (866 Views)

Re: How can I delete entire lines based on a search expression in vi?

[ Edited ]

Ok, Merijn, I'm not so unscriptable ;)

 

The script ran wonderfuly with just a little change in the file and script from <BillingAddress> to <FBillingAddress> because there were other <BillingAddress> I didn't want to be found:

 

./MyFirstPerlScrit.pl file-to-format.xml > file-formated.xml

 

Thanks,

 

Eric

 

 

Each and every day is a good day to learn.
Acclaimed Contributor
James R. Ferguson
Posts: 21,184
Registered: ‎07-06-2000
Message 18 of 22 (863 Views)

Re: How can I delete entire lines based on a search expression in vi?


H.Merijn Brand (procura wrote:

JRF, s/\A/#/ :)

 

(first line of a script starts with #!/path/to/program (the # was missing)

 

More serious, once you get here, it might be worth looking at XML parser modules and modify the content in a more structural way. When done, use the module's methods to write valid XML to disk 


Yes, thanks for pointing out the absent interpreter line :-)  I editted my post to reflect that change.

 

I know you are correct when you note that the XML parser modules are far better than the roll-your-own method I chose.  The decent into HTML or XML hell can be steep and slippery :-)  Thanks, Merijn!

 

Regards!

 

...JRF...

Acclaimed Contributor
James R. Ferguson
Posts: 21,184
Registered: ‎07-06-2000
Message 19 of 22 (858 Views)

Re: How can I delete entire lines based on a search expression in vi?


Eric Antunes wrote:

The script ran wonderfuly with just a little change in the file and script from <BillingAddress> to <FBillingAddress> because there were other <BillingAddress> I didn't want to be found:

 


Hi (again) Eric:

 

If it was only the first stanza that you wanted to change, a slight code change would have enabled you to leave your input file alone.

 

Change these lines:

 

if (m{<BillingAddress>}..m{</BillingAddress>}) {
       
if (m{<ShipFromAddress>}..m{</ShipFromAddress>}) {

 TO:

 

if (m?<BillingAddress>?..m?</BillingAddress>?) {
        
if (m?<ShipFromAddress>?..m?</ShipFromAddress>?) {

That is, alter the match delimiter from "{" and "}" to "?" and "?".

 

This will match one pattern range, only.

 

Regards!

 

...JRF...

Honored Contributor
H.Merijn Brand (procura
Posts: 6,189
Registered: ‎10-13-1997
Message 20 of 22 (849 Views)

Re: How can I delete entire lines based on a search expression in vi?

Or use the triple-dot

from 'man perlop'

   Range Operators
       Binary ".." is the range operator, which is really two different
       operators depending on the context.  In list context, it returns a list
       of values counting (up by ones) from the left value to the right value.
       If the left value is greater than the right value then it returns the
       empty list.  The range operator is useful for writing "foreach (1..10)"
       loops and for doing slice operations on arrays. In the current
       implementation, no temporary array is created when the range operator
       is used as the expression in "foreach" loops, but older versions of
       Perl might burn a lot of memory when you write something like this:

           for (1 .. 1_000_000) {
               # code
           }

       The range operator also works on strings, using the magical auto-
       increment, see below.

       In scalar context, ".." returns a boolean value.  The operator is
       bistable, like a flip-flop, and emulates the line-range (comma)
       operator of sed, awk, and various editors.  Each ".." operator
       maintains its own boolean state.  It is false as long as its left
       operand is false.  Once the left operand is true, the range operator
       stays true until the right operand is true, AFTER which the range
       operator becomes false again.  It doesn't become false till the next
       time the range operator is evaluated.  It can test the right operand
       and become false on the same evaluation it became true (as in awk), but
       it still returns true once.  If you don't want it to test the right
       operand till the next evaluation, as in sed, just use three dots
       ("...") instead of two.  In all other regards, "..." behaves just like
       ".." does.

 Personally I have never ever felt the need for ??

YMMV TIMTOWTDI 

 

Enjoy, Have FUN! H.Merijn
Honored Contributor
Eric Antunes
Posts: 1,944
Registered: ‎06-15-2003
Message 21 of 22 (836 Views)

Re: How can I delete entire lines based on a search expression in vi?

Hi James,

 

Given that the xml file contains several patterns like:

 

 

<BillingAddress>..</BillingAddress>

<ShipToAddress>..</ShipToAddress>

..

<BillingAddress>..</BillingAddress>

<ShipFromAddress>..</ShipFromAddress>

..

<BillingAddress>..</BillingAddress>

<ShipToFromAddress>..</ShipToFromAddress>

..

 

And I just wanted to format the 2º pattern:

 

<BillingAddress>..</BillingAddress>

<ShipFromAddress>..</ShipFromAddress>

 

I coud use the following at the upper level:

 

if (m{<BillingAddress>}..m{</ShipFromAddress>}) {

 

Couldn't I?

 

Thanks,

 

Eric

Each and every day is a good day to learn.
Honored Contributor
H.Merijn Brand (procura
Posts: 6,189
Registered: ‎10-13-1997
Message 22 of 22 (834 Views)

Re: How can I delete entire lines based on a search expression in vi?

[ Edited ]

No. The .. operator is a range operator

 

If you want to match a single line where both the opening and the closing tag have *simple* data in between the tags (e.g. no < or other nested stuff),

 

if (m{<(BillingAdress)>[^<]*</\1>}) {
    # Do something on this line

# Keep the current indent
my ($indent) = (m/^(\s*)/);

# Insert a new line before (same indent)
s{^}{$indent<newTag>content</newTag>\n};

# Add a new line after this (same indent)
$_ .= "\n$indent<newTag>content</newTag>"; # TIMTOWTDI
}

 

is what you'd want

Enjoy, Have FUN! H.Merijn
The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation.